Senior Data Engineer

Posted by Rachel Silver

Company Details

Allegheny County

Pittsburgh PA

FTE only

Description

Why you should join us:

We’re hiring a Senior Data Engineer in the Department of Information Technology’s Data & Engineering Division. We can’t match private market salaries, but we offer work life balance, mission-driven work, and the chance to make an impact in your own community.

You’ll build ETL pipelines in Airflow, document County data sources and integrations, and partner with data stewards to prepare datasets for the Western PA Regional Data Center, the County’s open data portal. DIT is modernizing the county data layer, so you’d be shaping the platform, not inheriting it.

Position Summary:

The Data & Engineering Division within the Department of Information Technology (DIT) executes and modernizes data and engineering functions, building a scalable data platform and reliable, secure systems. The incumbent in this position is responsible for strategizing, designing and maintaining County wide systems and applications. This position reports directly to the Deputy Director of Data & Engineering.

Overview:

Allegheny County manages a wide range of programs and services for residents, including public safety, health, public works, parks, and economic development. The Department of Information Technology is modernizing its data storage and integration, moving toward an agile hybrid model that brings robust master data management and seamless software integration to the County. Contribute directly to strategic priorities, harness data analytics to drive impactful process improvements, and play a key role in shaping the future of public services. We are seeking applicants ready to grow their skills and make a difference, and help lead Allegheny County’s data-driven initiatives. Join an innovative team where Data Engineers are empowered to drive transformation within the County.

Duties:

  • Works closely with stakeholders to understand data-related needs and opportunities.
  • Develops Extract, Transform, Load (ETL ) pipelines in Airflow that provide accurate and reliable data for County users.
  • Documents County data sources, workflows, integrations and endpoints.
  • Partners with Data-Stewards to prepare and maintain datasets for the Western PA Regional Data Center, the County’s open data portal.
  • Assists Data Analysts with their data needs.
  • Perform other tasks and duties as requested or required.
  • Knowledge, Skills, and Abilities

Knowledge of:

  • General programming skills.
  • Data cleaning and manipulation techniques, in Python, SQL and R.
  • Reporting systems & tools.
  • Version control systems, including managing repositories, branching, and committing code.
  • Configuration and utilization of common data sources.
  • Building and deploying Docker images.
  • Cloud technologies and hosting platforms.

Skill in:

  • Linux (Ubuntu), Python, SQL, and R.
  • Reporting systems & tools.
  • Git, GitHub and additional platforms, e.g. integrated development environments (IDEs).
  • MS SQL Server, Oracle, and application programming interfaces (API’s).
  • Docker.
  • Azure.
  • Microsoft Office Suite including Microsoft CoPilot.
  • Generative AI systems, e.g. Claude AI.

Ability to:

  • Research best practices for the delivery of County ETL, data services and local implementation issues.
  • Assess data infrastructure, discover anomalies, and iteratively refine analysis and documentation based on feedback from the Data & Engineering team and from data users.
  • Use, leverage and evaluate generative AI.
  • Learn and follow County processes and procedures for data and regulations imposed by state or federal government agencies.
  • Manage time effectively: e.g. prioritize, complete assignments in a detail-oriented and organized manner.
  • Be team-oriented and skilled working within a collaborative environment.
  • Adapt to changing priorities and manage multiple tasks in a dynamic environment.
  • Communicate effectively, orally, visually and in writing.
  • Establish and maintain effective working relationships with supervisors, associates, outside agencies and the public.

How to Apply

Please log in or sign up to view this posting's application instructions.