Autodesk Principal Data Engineer in California
Job Requisition ID #
Autodesk operates in the water infrastructure software market which is experiencing structural growth, driven by multiple factors, including: emerging economies building water infrastructure to accommodate rapid urbanization; developed countries requiring increasingly sophisticated management of aging water resources; increasing levels of storms and floods as a result of climate change; and the need to manage the cost of water infrastructure ownership as total water infrastructure assets continue to grow.
The Principal Data Engineer will participate in Innovyze’s cutting edge SaaS platform build out.
This is a key position within our SaaS development organization which is set to handle massive data scale and ground-breaking machine learning solutions.
Designs and builds data provisioning workflows/pipelines, physical data schemas, extracts, data transformations, and data integrations and/or designs using ETL and API microservices.
Analyze, develop and execute data integration solutions, in order to manage the information lifecycle needs of an organization.
Builds data architecture and applications that enable reporting, analytics, data science, and data management and improve accessibility, efficiency, governance, processing, and quality of data.
Improve speed to market by focusing on current data needs as well as building out the long-term strategic data solutions using AWS, Snowflake, Mongo, SQL, as well as other modern data technologies
Design and develop programs and tools to support ingestion, curation and provisioning of complex enterprise data to achieve analytics, reporting, and data science.
Provide successful deployment and provisioning of data solutions to production or other required environments.
Analyze complex technical problems and is expected to recommend process improvements that address complex technology gaps within a single business process and improve data reliability, quality, and efficiency.
Work in a dynamic and exciting agile environment with Scrum Masters, Product Owners, and team members to develop creative data-driven solutions with our ETL pipeline that meet business and technical initiatives.
Actively participates in and often leads peer development and code reviews within each agile sprint, with focus on test driven development and Continuous Integration and Continuous Development (CICD).
Bachelors or master’s degree in Computer Science, Engineering, Statistics, Information Systems or in other quantitative fields.
8+ years of professional experience in Data Platform Administration/Engineering, or related.
Highly proficient in data engineering languages and tools, and strong proficiency in general programming languages and frameworks; ability to develop on multiple platforms.
Extensive understanding of agile data engineering concepts and processes, such as CICD, pipelines, and iterative development and deployments
Demonstrated experience delivering data solutions via agile methodologies on AWS, S3, Athena, Snowflake, Mongo
Experience in migrating ETL processes (not just data) from relational warehouse Databases to AWS based solutions.
Experience in building & utilizing tools and frameworks within the Big Data ecosystem including Kafka, Spark, and NoSQL.
Knowledge of Data Warehouse technology (Unix/Teradata/Ab Initio/Python/Spark/Snowflake/No SQL).
Requires critical thinking, data analysis, and data modeling experience (Data Vault experience a plus)
Experience with ETL and knowledge of variety of data platforms
Demonstrates leadership and active pursuit of optimizing data, CI/CD process and tools, testing frameworks & practices
Must be proactive and self-driven, demonstrated initiative and be a logical thinker.
Strong leadership, communication, collaboration skills with a track record of taking solution ownership
At Autodesk, we're building a diverse workplace and an inclusive culture to give more people the chance to imagine, design, and make a better world. Autodesk is proud to be an equal opportunity employer and considers all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender, gender identity, national origin, disability, veteran status or any other legally protected characteristic. We also consider for employment all qualified applicants regardless of criminal histories, consistent with applicable law.
Are you an existing contractor or consultant with Autodesk? Please search for open jobs and apply internally (not on this external site). If you have any questions or require support, contact Autodesk Careers (Careers%20%3Ccareers@autodesk.com%3E) .
Autodesk is the global leader in design and make technology, including industry-leading 3D design, engineering, and entertainment software and services, that offer customers better outcomes through automation and insights for their design and make processes. With over $3.5 billion in revenue and more than 12,000 employees, Autodesk has established itself as the leading provider of design and make technology that empowers innovators everywhere to achieve the new possible – for products, their businesses and the world. If you've ever driven a high-performance car, admired a towering skyscraper, used a smartphone, or watched a great film, chances are you've experienced what millions of Autodesk customers are doing with our software. With a vision of a better world designed and made for all, Autodesk serves customers in architecture, engineering, and construction; product design and manufacturing; and digital media and entertainment industries. Its customers design, fabricate, manufacture, and build anything by visualizing, simulating, and analyzing real-world performance early in the design process.