Intel is looking for a highly motivated, talented and experienced data engineer to join our Product Data and Analytics (PDA) team.
We are developing a state-of-the-art high-scale cloud-based solution, leveraging a microservices architecture to go along with managed cloud services, all towards creating a modern SaaS data lakehouse, with self service capabilities, ingestion\consumption services, and other features that help data engineers and data scientists across Intel's design teams make better data-driven decisions.
Our team deploys fast and often, having code deployed in production shortly after it was written, focusing on safety, robustness and proper architecture of our backend that will eventually handle hundreds of thousands of daily events at a fast pace.
Software Developers and Data Engineers at PDA shape and improve our architecture daily to provide a cutting-edge analytics solution.
To achieve this, we use state-of-the-art technologies such as Databricks (Spark), Synapse, Azure Data Factory, Kafka, CosmosDB, GraphQL and Gremlin, SQL and NoSQL databases, in addition to hosted solutions that Azure has to offer and more…
We encourage engineering excellence and promote industry best practices, and we’re looking for great data engineers with a passion for challenging themselves while solving technical problems at a large scale.
We emphasize Personal growth - Enrich and expand your technical knowledge and stack by developing with the most cutting edge and versatile technologies and participating in various courses and learning programs.
To succeed in this position, you will:
- Develop and own generic ingestion framework based on spark engine.
- Develop best practices and standards that can be used by BI developers to build, optimize and maintain data pipelines.
- Be a focal point for guiding and mentoring bi developers which dealing with complicated data models and performance issues.
- Explore available technologies and develop solutions to continuously improve our data quality, workflow reliability, and scalability.
- Build tools to detect, improve data quality and monitor data pipeline performance.
Developing your skills through exceptional training as well as frequent coaching and mentoring from colleagues.
Qualifications
Qualifications:
- 4+ years deep hands-on experience in Apache Spark (Python)
- 4+ years experience developing in python including OOP programing principles
- 4+ years experience in design and implementation of Big Data technologies (Databricks - preferred) and familiarity with data architecture patterns, such as data warehouse, data/delta lake, streaming(advantage)
- Experience with cloud providers such as AWS, Azure or GCP
- Proficient in T-SQL Development - stored procs, functions, triggers, indexes, partitions etc..
- Deep knowledge in query tuning, performance tuning, troubleshooting, and debugging Spark Code.
- Familiarity with databases and analytics technologies in the industry including Data Warehousing/ETL, Relational Databases, or MPP like Azure synapse, snowflake, redshift etc..
- Experience with Visualization tools like Power BI\Tableau.
- Experience of working within an Agile environment - advantage
- Experience building and deploying a range of data engineering pipelines into production, including using automation best practices for CI/CD - advantage
Not sure you fit all criteria? Submit anyway, let us decide!
#PDA_IS_HIRING
Inside this Business GroupIntel's Information Technology Group (IT) designs, deploys and supports the information technology architecture and hardware/software applications for Intel. This includes the LAN, WAN, telephony, data centers, client PCs, backup and restore, and enterprise applications. IT is also responsible for e-Commerce development, data hosting and delivery of Web content and services.
Work Model for this Role
This role will be eligible for our hybrid work model which allows employees to split their time between working on-site at their assigned Intel site and off-site.
Get email alerts for the latest"Experienced Data Engineer jobs in Petach-tiqwa"
