Automation index
How much of a Data engineer’s job can AI already do?
A pipeline and a diagram sketch. Keeping it up at 3 a.m., with PII and a four-hour job, does not.
This percentage does not predict how many people will lose their jobs.
Task comparison
IS WORK OVER?
Data engineer
31%
AI can already do 31% of this job.
#36 / 623
View rankingData engineer
Where the time goes
Task weights are our estimates based on O*NET frequency data, not time shares published by O*NET.
The time saving for each task is estimated separately.
| Task | Share | AI | Points |
|---|---|---|---|
Design pipelines, models and orchestration.EstimateNo public source provides a precise figure. This is our estimate. | 24% | 50% | +12 |
Write SQL, Spark and data tests.EstimateNo public source provides a precise figure. This is our estimate. | 18% | 45% | +8.1 |
Incidents, quality and lineage in production.EstimateNo public source provides a precise figure. This is our estimate. | 16% | 22% | +3.5 |
Talk to analysts and negotiate data contracts.EstimateNo public source provides a precise figure. This is our estimate. | 16% | 18% | +2.9 |
Cloud cost, permissions and PII.EstimateNo public source provides a precise figure. This is our estimate. | 14% | 15% | +2.1 |
Decide architecture and technical debt.EstimateNo public source provides a precise figure. This is our estimate. | 12% | 20% | +2.4 |
| Total | 100% | 31% |
Modelled workweek: 100% · Public evidence: 0% · Estimate: 100% · Confidence: Low
Skills and activities
- Design pipelines, models and orchestration
- Write SQL, Spark and data tests
- Cloud cost, permissions and PII
- Decide architecture and technical debt
- ingeniero de datos
- data engineer
- etl
Sources for this job· O*NET 15-1243.00· ESCO/ISCO 2511
IS WORK OVER?
Junior developer
31%↓
#38 / 623
View rankingJunior developer
Where the time goes
Task weights are our estimates based on O*NET frequency data, not time shares published by O*NET.
The time saving for each task is estimated separately.
| Task | Share | AI | Points |
|---|---|---|---|
Write, analyze, review, and rewrite programs, using workflow chart and diagram, and applying knowledge of computer capabilities, subject matter, and symbolic logic.EstimateNo public source provides a precise figure. This is our estimate. | 13% | 48% | +6.2 |
Write, update, and maintain computer programs or software packages to handle specific jobs such as tracking inventory, storing or retrieving data, or controlling other equipment.EstimateNo public source provides a precise figure. This is our estimate. | 11% | 28% | +3.1 |
Correct errors by making appropriate changes and rechecking the program to ensure that the desired results are produced.EstimateNo public source provides a precise figure. This is our estimate. | 11% | 28% | +3.1 |
Perform or direct revision, repair, or expansion of existing programs to increase operating efficiency or adapt to new requirements.EstimateNo public source provides a precise figure. This is our estimate. | 9% | 12% | +1.1 |
Conduct trial runs of programs and software applications to be sure they will produce the desired information and that the instructions are correct.EstimateNo public source provides a precise figure. This is our estimate. | 8% | 28% | +2.2 |
Consult with managerial, engineering, and technical personnel to clarify program intent, identify problems, and suggest changes.EstimateNo public source provides a precise figure. This is our estimate. | 6% | 28% | +1.7 |
Develop Web sites.EstimateNo public source provides a precise figure. This is our estimate. | 6% | 28% | +1.7 |
Compile and write documentation of program development and subsequent revisions, inserting comments in the coded instructions so others can understand the program.EstimateNo public source provides a precise figure. This is our estimate. | 6% | 55% | +3.3 |
Other less frequent tasks (weight estimated from frequency).EstimateNo public source provides a precise figure. This is our estimate. | 30% | 28% | +8.4 |
| Total | 100% | 31% |
Modelled workweek: 100% · Public evidence: 0% · Estimate: 100% · Confidence: Low
Skills and activities
- write code
- programming
- software development
- coding
- debug code
- computer programming
- decentralized application frameworks
- blockchain openness
- software components libraries
- ICT debugging tools
Sources for this job· O*NET 15-1251.00· ESCO/ISCO 2512