Share this Job

Databricks Engineer

Publication Date:  Jan 28, 2023
Ref. No:  412277
Location: 

Timisoara, RO, 300088

About Atos

Atos is a global leader in digital transformation with 107,000 employees and annual revenue of over € 11 billion. European number one in cybersecurity, cloud and high performance computing, the Group provides tailored end-to-end solutions for all industries in 71 countries. A pioneer in decarbonization services and products, Atos is committed to a secure and decarbonized digital for its clients. Atos is a SE (Societas Europaea), listed on Euronext Paris and included in the  CAC 40 ESG and Next 20 Paris Stock indexes.

 

The purpose of Atos is to help design the future of the information space. Its expertise and services support the development of knowledge, education, and research in a multicultural approach and contribute to the development of scientific and technological excellence. Across the world, the Group enables its customers and employees, and members of societies at large to live, work and develop sustainably, in a safe and secure information space.

 

 

Your main responsibilities will be: 

  • Designing and implementing highly performant data  pipelines from multiple sources using Apache Spark and/or Azure Databricks 

  • Integrating the end to end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times 

  • Working with other members of the project team to support delivery of additional project components (API interfaces) 

  • Evaluating the performance and applicability of multiple tools against customer requirements 

  • Working within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints. 

  • Integrate Databricks with other technologies (Ingestion tools, Visualization tools ) 

 

Knowledge, Skills, and Abilities:  

  • Proven experience working as a data engineer  

  • Highly proficient in using the spark framework (python and/or scala) 

  • Extensive knowledge of Data Warehousing concepts, strategies, methodologies. 

  • Programming experience in Scala or Python, SQL 

  • Direct experience of building data pipelines using Azure Data Factory and Apache Spark (preferably in Databricks). 

  • Hands on experience designing and delivering solutions using Azure  including Azure Storage, Azure SQL Data Warehouse, Azure Data Lake, Azure Cosmos DB, Azure Stream Analytics 

  • Experience with ingestion tools (nifi/azure cloud factory 

  • Experience with big data technologies (hadoop ) 

  • Experience with ingestion tools (nifi/azure cloud factory 

  • Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J) 

  • Databricks & Azure Big Data Architecture Certification would be plus 

  • Must be team oriented with strong collaboration, prioritization, and adaptability skills required 

 

Work experience: At least three years of experience designing and delivering data engineering solutions. 

What we are offering: flexible work schedule, flexible workload, fix income (according to the workload contracted), meal tickets, private healthcare, technical training. 

 

Here at Atos, we want all of our employees to feel valued, appreciated, and free to be who they are at work. Our employee lifecycle processes are designed to prevent discrimination against our people regardless of gender identity or expression, sexual orientation, religion, ethnicity, age, neurodiversity, disability status, citizenship, or any other aspect which makes them unique. Across the globe, we have created a variety of programs to embed our Atos culture of inclusivity, and work hard to ensure that all of our employees have an equal opportunity to contribute and feel that they are exactly where they belong.