← all systems · see it in The System
Linear algebra (the practice of solving, transforming and taking apart linear systems with vectors and matrices, and the structures it works with)
Linear algebra is the branch of mathematics concerning linear equations such as a 1 x 1 + ⋯ + a n x n = b, linear maps such as the following: ↦ a 1 x 1 + ⋯ + a n x n, and their representations in vector spaces and through matrices. Linear algebra is central to almost all areas of mathematics.
Properties published scienceour proposal
Sourced fields, and our own readings.
| aliases | Linear algebra |
| born at | elimination on counting-rod arrays in the Nine Chapters (parts about 150 BC; C-1198); vector spaces from Grassmann (1844) and Peano (1888); modern form in the first half of the 20th century |
| born precision | centuries |
| boundary | Inside: the practice of writing simultaneous linear conditions as vectors and matrices and solving, transforming, factoring and decomposing them (by hand, by human computers with bracket notation and tables, by machines running BLAS and LAPACK), the three modes in which people describe and think it (geometric arrows and planes, arithmetic n-tuples and matrices, structural vector spaces), and the structures it works with (vector spaces, linear maps, bases and dimension, kernels and images, determinants, eigenvalues and eigenvectors, inner products, duality; modules and tensors as extensions). Outside: the algebra, arithmetic and geometry it draws on, the sciences, engineering, statistics, search engines, graphics and machine learning that run on its results, the people and machines that carry it, and the writing that holds its arrays. |
| nested level | A branch of mathematics (part inside a whole), shelved by the algebra walk as a kind of algebra (C-1189); runs on algebra's and arithmetic's operations (their L6) and on writing; carried by people (rung 11), by computers (rung 12) and inside trained neural networks (rung 13); the structures as a role at rung 0. |
| scale | social |
Measures (18) published science
| characteristic clock: hand solution of normal equations by a professional human computer (Doolittle, 1878) | 41 equations per week equations/week |
| characteristic clock: 18 equations with desk calculators, four mathematicians including Turing (1946) | about 2 weeks |
| characteristic clock: multiplying punch (1930s-1940s), 10 simultaneous equations | about 4 hours |
| characteristic clock: PageRank for 26 million Web pages on a medium size workstation (1998) | a few hours |
| arithmetic operations to solve n equations by elimination | about 2n^3/3 operations |
| operations for n = 18 by elimination (Grcar's check) | approximately 3,888 operations |
| matrix multiplication exponent, upper bound (2023) | omega <= 2.371552 (from 2.371866) exponent |
| multiplications for 4x4 matrices over Z2: AlphaTensor vs Strassen two-level | 47 vs 49 multiplications |
| non-equivalent factorizations found departing from Strassen-square (one size) | more than 14,000 factorizations |
| matrix multiplication tensors improved over state of the art (n, m, p <= 12) | more than 70 tensors |
| growth factor bound, complete pivoting (2023-2025) | n^(0.2079 ln n + 0.91), improving Wilkinson's 1961 2n^(0.25 ln n + 0.5) ratio |
| Nine Chapters, chapter eight: problems solved by elimination | 18 problems, 2 to 5 equations |
| first LINPACK benchmark report (1979) | 23 computers, matrix of size 100 |
| LINPACK 100 benchmark work | roughly 2/3 million floating-point operations |
| TOP500 list | 500 most powerful systems, compiled twice a year since 1993 |
| HPL look-ahead depth with best gain | 1 or 2 panels |
| PageRank damping factor (usual setting) | 0.85 probability |
| AlphaTensor speed-up benchmark size | 8,192 x 8,192 (median over 200 runs; s.d. < 0.4 percentage points) matrix size |
Open contentions (5) open contention
Where sources or readings disagree. Both stay on the map.
- C-413 Where do thoughts come from?
booked: No theory is proven, so the map lists the main ones side by side and doesn't pick one. It shows where thinking is handled in the brain, not where thoughts start.
the other reading: see C-413 (where thoughts come from) - C-736 When a system first throws away its excess energy and later learns to store it for reuse, is that one process that grew or two separate ones?
booked: The map keeps both readings side by side and rules neither. A few examples fit the 'one process that grew' reading, but it hasn't been tested.
the other reading: a plain toll (information lost); a hand-off to another user (the discarded variance as noise for another analysis) - C-1187 When did linear algebra begin?
booked: The map dates the practice to solving equations with arrays in the Chinese Nine Chapters (about 150 BC), and keeps the view that linear algebra proper began with vector spaces in the 19th century.
the other reading: linear algebra proper begins with vector spaces (Grassmann 1844; Peano's definition 1888; the modern form in the first half of the 20th century), and earlier elimination is its prehistory; the European line (Cardano 1545; Newton 1669-1670; Gauss's notation 1810) is the root of the modern method; Grcar finds the Chinese and European developments independent; the structure itself as a rung-0 role (C-011 reading), with the idea at rung 11 - C-1188 Which parts of the brain do advanced mathematics?
booked: The map records that experts use a network across the frontal, parietal and temporal lobes, not language areas, while noting this is inferred from related fields and not tested for each field by name.
the other reading: no imaging study of linear algebra by name was read: the network is inferred from neighbouring domains; the geometric and arithmetic modes may draw on different circuits (space vs number); not tested in the sources read - C-1198 When was China's Nine Chapters on the Mathematical Art written?
booked: The map uses parts written as early as about 150 BC, and keeps the wider 10th-2nd century BCE range alongside.
the other reading: written in the 10th-2nd century BCE (Matrix article)
Partners and parts published science
Built from / builds (9)
- Vector space: sets whose elements can be added and scaled, as mathematics describes it, with bases and dimension, linear maps, inner products, and their use as the state spaces of physics and data
- Linear maps (maps that keep addition and scaling)
- Matrix (mathematics): the rectangular array of numbers and its algebra, determinants and eigenvalues, matrices as linear maps, their history, and their use in physics, graphics and machine learning; the practice and the structure both booked
- Systems of linear equations
- Gaussian elimination (row reduction)
- Eigenvalues and eigenvectors
- Matrix decompositions (LU, QR, SVD, eigendecomposition)
- The three modes of description and thinking (geometric, arithmetic, structural)
- BLAS and LAPACK (the machine kernels)
Sits inside / holds (6)
- Vector space: sets whose elements can be added and scaled, as mathematics describes it, with bases and dimension, linear maps, inner products, and their use as the state spaces of physics and data
- Human (Homo sapiens)
- Mathematics (the field: the practice and the structures it studies)
- Computer
- Algebra (the practice of solving for unknowns and transforming expressions, and the structures it works with)
- Matrix (mathematics): the rectangular array of numbers and its algebra, determinants and eigenvalues, matrices as linear maps, their history, and their use in physics, graphics and machine learning; the practice and the structure both booked
Trades with (valence) (25)
- Vector calculus (the calculus of fields: gradient, divergence, curl; the practice and the structures it works on) via sys:sensory-environment · Linear algebra (the practice of solving, transforming and taking apart linear systems with vectors and matrices, and the structures it works with) gain
- Quantum mechanics via sys:sensory-environment · Linear algebra (the practice of solving, transforming and taking apart linear systems with vectors and matrices, and the structures it works with) gain
- Vector space: sets whose elements can be added and scaled, as mathematics describes it, with bases and dimension, linear maps, inner products, and their use as the state spaces of physics and data via sys:sensory-environment · Linear algebra (the practice of solving, transforming and taking apart linear systems with vectors and matrices, and the structures it works with) gain
- Hamiltonian and Lagrangian mechanics (analytical mechanics: classical mechanics built from energy functions and the stationary action, and the practice of using them) via sys:sensory-environment · Linear algebra (the practice of solving, transforming and taking apart linear systems with vectors and matrices, and the structures it works with) even
- Human (Homo sapiens) via sys:sensory-environment · Linear algebra (the practice of solving, transforming and taking apart linear systems with vectors and matrices, and the structures it works with) gain
- Writing (the practice of marking language on a surface, and the script plus rules it works with) via sys:sensory-environment · Linear algebra (the practice of solving, transforming and taking apart linear systems with vectors and matrices, and the structures it works with) gain
- Engineering (design) via sys:sensory-environment · Linear algebra (the practice of solving, transforming and taking apart linear systems with vectors and matrices, and the structures it works with) gain
- Internet via sys:sensory-environment · Linear algebra (the practice of solving, transforming and taking apart linear systems with vectors and matrices, and the structures it works with) gain
- Harmonic oscillator via sys:sensory-environment · Linear algebra (the practice of solving, transforming and taking apart linear systems with vectors and matrices, and the structures it works with) gain
- Large language model via sys:sensory-environment · Linear algebra (the practice of solving, transforming and taking apart linear systems with vectors and matrices, and the structures it works with) gain
- Shapes (geometry): the practice and the structure via sys:sensory-environment · Linear algebra (the practice of solving, transforming and taking apart linear systems with vectors and matrices, and the structures it works with) gain
- Measurement (the practice of comparing a quantity with a unit, and the units and standards it uses) via sys:sensory-environment · Linear algebra (the practice of solving, transforming and taking apart linear systems with vectors and matrices, and the structures it works with) gain
- Computer via sys:sensory-environment · Linear algebra (the practice of solving, transforming and taking apart linear systems with vectors and matrices, and the structures it works with) gain
- Algebra (the practice of solving for unknowns and transforming expressions, and the structures it works with) via sys:sensory-environment · Linear algebra (the practice of solving, transforming and taking apart linear systems with vectors and matrices, and the structures it works with) gain
- Statistics: the practice of collecting and reasoning from data, the intuitive statistics it grows from, and the structure (samples, distributions, estimators) it works on via sys:sensory-environment · Linear algebra (the practice of solving, transforming and taking apart linear systems with vectors and matrices, and the structures it works with) gain
- Function (mathematics): the assignment of exactly one output to each input, and the practice of defining, drawing, composing and using it via sys:sensory-environment · Linear algebra (the practice of solving, transforming and taking apart linear systems with vectors and matrices, and the structures it works with) gain
- Calculus (the practice of handling change and accumulation by limits, and the structures it works on) via sys:sensory-environment · Linear algebra (the practice of solving, transforming and taking apart linear systems with vectors and matrices, and the structures it works with) gain
- Differential equations (the practice of writing and solving laws of change, and the equations it works on) via sys:sensory-environment · Linear algebra (the practice of solving, transforming and taking apart linear systems with vectors and matrices, and the structures it works with) gain
- Cryptography via sys:mental-representation · Linear algebra (the practice of solving, transforming and taking apart linear systems with vectors and matrices, and the structures it works with) gain
- Complex analysis (the practice of working with functions of a complex variable, and the holomorphic structure it works on) via sys:sensory-environment · Linear algebra (the practice of solving, transforming and taking apart linear systems with vectors and matrices, and the structures it works with) gain
- Public-key cryptography via sys:written-record · Linear algebra (the practice of solving, transforming and taking apart linear systems with vectors and matrices, and the structures it works with) gain
- Matrix (mathematics): the rectangular array of numbers and its algebra, determinants and eigenvalues, matrices as linear maps, their history, and their use in physics, graphics and machine learning; the practice and the structure both booked via sys:written-record · Linear algebra (the practice of solving, transforming and taking apart linear systems with vectors and matrices, and the structures it works with) gain
- Fourier analysis (the practice of splitting signals into waves and rebuilding them, and the structure it works on) via sys:sensory-environment · Linear algebra (the practice of solving, transforming and taking apart linear systems with vectors and matrices, and the structures it works with) gain
- Set theory: the study of sets (collections taken as single objects), membership, Cantor's infinities and the axioms, and the practice of the people and machines who work with them via sys:sensory-environment · Linear algebra (the practice of solving, transforming and taking apart linear systems with vectors and matrices, and the structures it works with) gain
- Graph theory: the practice of studying vertices joined by edges (problems, proofs, algorithms, its people and books) and the graphs it works on via sys:written-record · Linear algebra (the practice of solving, transforming and taking apart linear systems with vectors and matrices, and the structures it works with) gain
expressed by (12)
- Generation/Synthesis
- Recombination/Composition
- Scaffolding/Enablement (Meta-Tooling)
- Templating / Standardization
- Interoperability/Transduction (Bridging)
- Encapsulation & Modularity (Abstraction)
- Amplification/Scale-Up (Manufacture & Distribution)
- Mapping/Modeling
- Uncertainty Reduction/Learning
- Social Learning / Public Information Use
- Redundancy & Diversity
- Quality Control & Error Correction
floor filled by (21)
- Human (Homo sapiens)
- Writing (the practice of marking language on a surface, and the script plus rules it works with)
- Engineering (design)
- Internet
- Quantum mechanics
- Vector space: sets whose elements can be added and scaled, as mathematics describes it, with bases and dimension, linear maps, inner products, and their use as the state spaces of physics and data
- Large language model
- Human brain
- Measurement (the practice of comparing a quantity with a unit, and the units and standards it uses)
- Computer
- Statistics: the practice of collecting and reasoning from data, the intuitive statistics it grows from, and the structure (samples, distributions, estimators) it works on
- Linear maps (maps that keep addition and scaling)
- Gaussian elimination (row reduction)
- Eigenvalues and eigenvectors
- Matrix decompositions (LU, QR, SVD, eigendecomposition)
- The three modes of description and thinking (geometric, arithmetic, structural)
- BLAS and LAPACK (the machine kernels)
- Numerical linear algebra
- Public-key cryptography
- Matrix (mathematics): the rectangular array of numbers and its algebra, determinants and eigenvalues, matrices as linear maps, their history, and their use in physics, graphics and machine learning; the practice and the structure both booked
- Fourier analysis (the practice of splitting signals into waves and rebuilding them, and the structure it works on)
represents (1)
Kinds (6)
- Algebra (the practice of solving for unknowns and transforming expressions, and the structures it works with)
- Numerical linear algebra
- Module theory (linear algebra over a ring)
- Multilinear algebra and tensors
- Topological vector spaces (normed, Banach, Hilbert)
- Functional analysis
Notes published science
- In 1878 a single human computer at the US Coast Survey, Myrick Doolittle, solved 41 simultaneous equations in a week with paper and pencil; in 1946 four mathematicians, Alan Turing among them, needed about two weeks for 18 with desk calculators. And the method everyone calls 'Gaussian' was named for Gauss only in the 1950s, by confusion over its history (src:grcar-2011, src:wp:gaussian-elimination).
- The world's fastest computers are ranked by one school exercise: how fast they solve a big system of linear equations. The benchmark began in 1979 as an appendix of timings for 23 computers, 'in some sense, an accident' (src:dongarra-2003).
- Strassen's 1969 trick for multiplying 4x4 matrices with 49 multiplications stood for about 50 years, until a game-playing AI found one with 47 (in arithmetic mod 2), and more than 14,000 other ways nobody had seen (src:fawzi-2022).
- In 1978 the RSA inventors estimated that factoring a 200-digit number would take about 3.8 billion years; in 2019-2020 a team factored the 250-digit RSA-250 in roughly 2,700 core-years, and 250 of those core-years were spent on one big linear algebra step (src:rsa-1978, src:boudot-2020-rsa240).
Layers
The ways it takes in its world, where they meet, and how it acts back, each from L1 (where it meets the world) up.
a linear system: quantities combined by adding and scaling, written as vectors and matrices, and solved, transformed or taken apart (reader's view)
- L1: The problem in the world: several unknowns tied by linear conditions (survey angles, orbits, circuits, the Web's links, a scene to draw, a dataset), written as arrays on paper or numbers in memory
- L2: Taking it in: arrays read row by row and column by column, arrows and planes seen, data loaded from memory (one load and store per add/multiply pair unless blocks are reused)
- L3: Codes (the ports): geometric, arithmetic and structural modes; notations (rod arrays, Gauss's brackets, the single-letter matrix); for machines, the BLAS interface
- L4: Operating: elimination, multiplication, change of basis, factorization, iteration
- L5: Control: method choice, pivoting, conditioning, rounding-error bounds, convergence, checking
- L6: The structure: vector spaces, linear maps, bases and dimension, kernels and images, determinants, eigenvalues and eigenvectors, inner products, duality
- L7: Use: geometry, physics, engineering, scientific computation, statistics, search, graphics, machine learning
the boardroom (shared floors)
- L3: Codes (the ports): the three modes of description and thought: geometric (arrows, lines, planes, transformations), arithmetic (n-tuples, matrices, rank, solutions of systems) and structural (vector spaces, subspaces, dimension, operators, kernels); notations from counting-rod arrays and Gauss's brackets to a single letter for a matrix
- L4: Operating: row operations and elimination (about 2n^3/3 operations), back-substitution, matrix multiplication, change of basis, factorizations (LU, QR, SVD, eigendecomposition), iteration (power iteration, Krylov methods); by hand, by human computers, by machine kernels
- L5: Control: choosing the method (Cramer only for n = 2 or 3; elimination; stable decompositions over the normal equations), pivoting against small divisors, conditioning, growth-factor bounds on rounding error, convergence checks, duplicated hand calculation
- L6: The structure: vector spaces over a field, linear maps, subspaces, span, bases and dimension, kernel and image, determinants, eigenvalues and eigenvectors, inner products and duality; modules, tensors, Hilbert spaces as extensions; in expert mathematicians, carried by a bilateral prefrontal-parietal-temporal network shared with number and space (shown for algebra and other domains, not linear algebra by name)
- L7: Linear algebra put to use: geometry; physics (quantum states and operators, vibration modes, principal axes); engineering (fluids, power systems); scientific computation and the ranking of supercomputers; statistics (least squares, PCA); Web search (PageRank); computer graphics; machine learning (attention as matrix products)
way in: Data: observations and records arranged as arrays (survey angles, orbits, datasets, the Web's links)
- L1: Observations with errors, more than needed: supernumerary survey angles, astronomical positions; large datasets; links between Web pages
- L2: The observations written as an overdetermined system (more equations than unknowns); a dataset as a matrix; the Web as a link matrix
way in: Sight: arrows, lines, planes and transformations drawn (figures, animations, graphics)
- L1: Figures: planes whose intersection is the common solution of a system; vectors as arrows; a linear transformation rotating, stretching or shearing them; students reading eigen-equations as pictures
way in: Sight: vectors and matrices written as arrays (rows, columns, entries)
- L1: Arrays on a surface: a system's coefficient matrix and its right-member vector; in the Nine Chapters, rectangular arrays of counting rods
way in: The machine route: numbers in memory taken through BLAS/LAPACK kernels on processors
- L1: Floating-point numbers in memory that cannot represent all reals exactly
- L2: Loads and stores: for every add/multiply pair a load and store of the elements (the data-movement bottleneck)
- L3: Kernels: Level 1-3 BLAS; Level 3 does O(n^3) work on blocks so data is reused; GPUs built with a matrix structure
way in: The world's linear structure: phenomena that add and scale (vibrations, fields, quantum states), and nonlinear ones near a point
- L1: Physical phenomena for which linear structures are natural models; most are modelled by partial differential equations
- L2: Linearization: a first-order approximation (the derivative at a point gives the line that models local behaviour)
- L3: Discretization: space cut into small interacting cells, giving very large matrices
way in: Thought: an equation such as Ax = 2x held and read in the mind (relationally or operationally, as a picture or as numbers)
- L1: Resources a student brings to an eigen-equation: recognizing it, reading the equal sign relationally or operationally, knowing a relation can be a solution (where these resources come from is contested: C-413)
way in: Words: definitions, lessons and problems read or heard (textbooks, lectures, the lesson Newton supplied)
- L1: The lesson in words: how to solve simultaneous equations, written for learners; definitions of vector space and linear map
way out: Programming the machine: calls to BLAS/LAPACK, run on processors built for matrices
- L1: Processors with matrix structure (GPUs) executing the arithmetic
- L3: Kernel calls: Level 3 BLAS on blocks
- L5: Choosing the routine and its parameters (pivoting, block size, look-ahead depth)
way out: Rendering: transformations project a 3D scene onto a 2D screen
- L1: The image on the screen
- L4: Rotation and projection matrices applied to the object
- L7: A scene to be shown
way out: Speech and explanation: saying how the equation reads and what its solutions are
- L1: Spoken explanation in an interview (recorded on video and in transcripts)
- L6: The student's reasoning about the eigen-equation
way out: Writing each reduced array (the new rows after every elimination step)
- L1: Marks on paper: by hand, human computers wrote whole systems out (41 normal equations in a week)
- L4: The new rows: multiples of the leading equation subtracted from those below
- L6: The rule: row operations keep the solutions; the reduced form is unique
Who fills each layer
Sources (28) published science
Grcar JF. How ordinary elimination became Gaussian elimination. Historia Mathematica 38 (2011); arXiv:0907.2397. doi:10.1016/j.hm.2010.06.003 (behind its links)
Eigenvalues and eigenvectors (Wikipedia, via Wikimedia Enterprise) (behind its links)
Gaussian elimination (Wikipedia, via Wikimedia Enterprise) (behind its links)
Fawzi A, Balog M, et al. (2022) Discovering faster matrix multiplication algorithms with reinforcement learning. Nature 610:47-53. doi:10.1038/s41586-022-05172-4 (behind its links)
Vector space (Wikipedia, via Wikimedia Enterprise) (behind its links)
Matrix (mathematics) (Wikipedia, via Wikimedia Enterprise) (behind its links)
Numerical linear algebra (Wikipedia, via Wikimedia Enterprise) (behind its links)
Brin S, Page L. The anatomy of a large-scale hypertextual Web search engine. Computer Networks and ISDN Systems 30 (1998) (behind its links)
Vassilevska Williams V, Xu Y, Xu Z, Zhou R. New bounds for matrix multiplication: from alpha to omega. arXiv:2307.07970 (2023) (behind its links)
Bisain A, Edelman A, Urschel J (2023) A New Upper Bound For the Growth Factor in Gaussian Elimination with Complete Pivoting. arXiv:2312.00994 (behind its links)
Wawro M, Christensen W, Watson K. Student reasoning about eigenvectors and eigenvalues from a resources perspective. PERC 2019 (talk abstract) (behind its links)
Vaswani et al. 2017, Attention Is All You Need (arXiv:1706.03762) (behind its links)
Jolliffe IT, Cadima J. Principal component analysis: a review and recent developments. Phil Trans R Soc A 374:20150202 (2016). doi:10.1098/rsta.2015.0202 (behind its links)
Vector calculus (Wikipedia, via Wikimedia Enterprise snapshot 2026-11-01) (behind its links)
Quantum mechanics (encyclopedia, Wikimedia Enterprise Snapshot 2026-10-01) (behind its links)
Hamiltonian mechanics (encyclopedia, Wikimedia Enterprise snapshot 2026-11-01, version 1381752488) (behind its links)
Ponte JP (1992) The history of the concept of function and some educational implications. The Mathematics Educator 3(2) (behind its links)
Complex number (Wikipedia, via Wikimedia Enterprise snapshot 2026-11-01) (behind its links)
NIST, FIPS 203: Module-Lattice-Based Key-Encapsulation Mechanism Standard, August 2024 (doi:10.6028/NIST.FIPS.203) (behind its links)
Discrete Fourier transform (Wikipedia, via Wikimedia Enterprise snapshot 2026-11-01) (behind its links)
Axiom of choice (Wikipedia, via Wikimedia Enterprise snapshot 2026-11-01) (behind its links)
Graph theory (Wikipedia, via Wikimedia Enterprise snapshot 2026-11-01) (behind its links)