Jump to content

TensorFlow

From Wikipedia, the free encyclopedia
This is an old revision of this page, as edited by BrainDozer (talk | contribs) at 23:20, 28 August 2017 (See also: added Convolutional neural network; alphabetized list). The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision.
TensorFlow
Developer(s)Google Brain Team[1]
Initial releaseNovember 9, 2015; 9 years ago (2015-11-09)
Stable release
1.3.0[2] / August 17, 2017; 7 years ago (2017-08-17)
Repository
Written inPython, C++, CUDA
PlatformLinux, macOS, Windows, Android
TypeMachine learning library
LicenseApache 2.0 open source license
Websitewww.tensorflow.org

TensorFlow is an open-source software library for machine learning across a range of tasks. It is a system for building and training neural networks to detect and decipher patterns and correlations, analogous to (but not the same as) human learning and reasoning.[3] It is used for both research and production at Google,‍[3]: min 0:15/2:17 [4]: p.2 [3]: 0:26/2:17  often replacing its closed-source predecessor, DistBelief.

TensorFlow was developed by the Google Brain team for internal Google use. It was released under the Apache 2.0 open source license on November 9, 2015.[1][5]

History

DistBelief

Starting in 2011, Google Brain built DistBelief as a proprietary machine learning system based on deep learning neural networks. Its use grew rapidly across diverse Alphabet companies in both research and commercial applications.[4][6] Google assigned multiple computer scientists, including Jeff Dean, to simplify and refactor the codebase of DistBelief into a faster, more robust application-grade library, which became TensorFlow.[7] In 2009, the team, led by Geoffrey Hinton, had implemented generalized backpropagation and other improvements which allowed generation of neural networks with substantially higher accuracy, for instance a 25% reduction in errors in speech recognition.[8]

TensorFlow

TensorFlow is Google Brain's second generation system. Version 1.0.0 was released on February 11, 2017[9]. While the reference implementation runs on single devices, TensorFlow can run on multiple CPUs and GPUs (with optional CUDA extensions for general-purpose computing on graphics processing units).[10] TensorFlow is available on 64-bit Linux, macOS, Windows, and mobile computing platforms including Android and iOS.

TensorFlow computations are expressed as stateful dataflow graphs. The name TensorFlow derives from the operations that such neural networks perform on multidimensional data arrays. These arrays are referred to as "tensors". In June 2016, Dean stated that 1,500 repositories on GitHub mentioned TensorFlow, of which only 5 were from Google.[11]

Tensor processing unit (TPU)

In May 2016 Google announced its tensor processing unit (TPU), a custom ASIC built specifically for machine learning and tailored for TensorFlow. TPU is a programmable AI accelerator designed to provide high throughput of low-precision arithmetic (e.g., 8-bit), and oriented toward using or running models rather than training them. Google announced they had been running TPUs inside their data centers for more than a year, and have found them to deliver an order of magnitude better-optimized performance per watt for machine learning.[12]

In May 2017 Google announced the second-generation, as well as the availability of the TPUs in Google Compute Engine.[13] The second-generation TPUs deliver up to 180 teraflops of performance, and when organized into clusters of 64 TPUs, provide up to 11.5 petaflops.

TensorFlow Lite

In May 2017 Google announced a software stack specifically for Android development, TensorFlow Lite,[14] beginning with Android Oreo.

Applications

Google officially released RankBrain on 26 October 2015, backed by TensorFlow.

Features

TensorFlow provides a Python API, as well as C++, Haskell, Java, Go, and Rust APIs. Third party packages are available for Julia, R, and Scala.

Applications

Among the applications for which TensorFlow is the foundation, are automated image captioning software, such as DeepDream.[15] RankBrain now handles a substantial number of search queries, replacing and supplementing traditional static algorithm based search results.[16]

See also

References

  1. ^ a b "Credits". TensorFlow.org. Retrieved 10 November 2015.
  2. ^ "TensorFlow Release". Retrieved 2017-06-19.
  3. ^ a b c "TensorFlow: Open source machine learning" "It is machine learning software being used for various kinds of perceptual and language understanding tasks" — Jeffrey Dean, minute 0:47 / 2:17 from Youtube clip
  4. ^ a b Dean, Jeff; Monga, Rajat; et al. (November 9, 2015). "TensorFlow: Large-scale machine learning on heterogeneous systems" (PDF). TensorFlow.org. Google Research. Retrieved 10 November 2015.
  5. ^ Metz, Cade (November 9, 2015). "Google Just Open Sourced TensorFlow, Its Artificial Intelligence Engine". Wired. Retrieved 10 November 2015.
  6. ^ Perez, Sarah (November 9, 2015). "Google Open-Sources The Machine Learning Tech Behind Google Photos Search, Smart Reply And More". TechCrunch. Retrieved 11 November 2015.
  7. ^ Oremus, Will (November 11, 2015). "What Is TensorFlow, and Why Is Google So Excited About It?". Slate. Retrieved 11 November 2015.
  8. ^ Ward-Bailey, Jeff (November 25, 2015). "Google chairman: We're making 'real progress' on artificial intelligence". CSMonitor. Retrieved 25 November 2015.
  9. ^ "Tensorflow Release 1.0.0". {{cite web}}: Cite has empty unknown parameter: |dead-url= (help)
  10. ^ Metz, Cade (November 10, 2015). "TensorFlow, Google's Open Source AI , Points to a Fast-Changing Hardware World". Wired. Retrieved 11 November 2015.
  11. ^ Machine Learning: Google I/O 2016 Minute 07:30/44:44 accessdate=2016-06-05
  12. ^ Jouppi, Norm. "Google supercharges machine learning tasks with TPU custom chip". Google Cloud Platform Blog. Retrieved 19 May 2016.
  13. ^ "Build and train machine learning models on our new Google Cloud TPUs". Google. 2017-05-17. Retrieved 2017-05-18.
  14. ^ Google’s new machine learning framework is going to put more AI on your phone
  15. ^ Byrne, Michael (November 11, 2015). "Google Offers Up Its Entire Machine Learning Library as Open-Source Software". Vice. Retrieved 11 November 2015.
  16. ^ Woollaston, Victoria (November 25, 2015). "Google releases TensorFlow – Search giant makes its artificial intelligence software available to the public". DailyMail. Retrieved 25 November 2015.