Big data Jobs

International Cyber Security product company seeks talented Java Developer with heavy Big Data experience. Show less [{"type":"people_also_viewed","href":"https://au..com/jobs/view/senior-software-engineer-fullstack-growth-at-heidi-4368453115","jobId":"4368453115","label":"Senior Software Engineer (Fullstack - Growth)"},{"type":"people_also_viewed","href":"https://au..com/jobs/view/senior-full-stack-engineer-at-haast-4353508607","jobId":"4353508607","label":"Senior Full Stack Engineer"},{"type":"people_also_viewed","href":"https://au..com/jobs/view/senior-full-stack-developer-%E2%80%93-tech-lead-at-roomstay-4366004066","jobId":"4366004066","label":"Senior Full Stack Developer – Tech Lead"},{"type":"similar_search","href":"https://www..com/jobs/java-application-developer-jobs","label":"Empleos de Desarrollador de aplicaciones Java"},{"type":"similar_search","href":"https://www..com/jobs/java-web-developer-jobs","label":"Empleos de Desarrollador de Java y web"},{"type":"similar_search","href":"https://www..com/jobs/java-consu...

Any Graduate BE/ BTech/BSc/MCA 5 years Hands on in Redshift and warehousing hands-on knowledge. Strong Python Scripting skills AWS services like Lambda, S3, Glue, SNS Immediate joiners- serving NP until month end only Show less [{"type":"people_also_viewed","href":"https://in..com/jobs/view/data-engineer-at-p99soft-4369856638","jobId":"4369856638","label":"Data Engineer"},{"type":"people_also_viewed","href":"https://in..com/jobs/view/remote-data-engineer-60713-at-turing-4371038515","jobId":"4371038515","label":"Remote Data Engineer - 60713"},{"type":"people_also_viewed","href":"https://in..com/jobs/view/remote-data-engineer-60713-at-turing-4371045387","jobId":"4371045387","label":"Remote Data Engineer - 60713"},{"type":"people_also_viewed","href":"https://in..com/jobs/view/iot-data-engineer-at-canonical-4251073394","jobId":"4251073394","label":"IoT Data Engineer"},{"type":"people_also_viewed","href":"https://in..com/jobs/view/remote-data-engineer-60713-at-turing-4371052335","jobId":"4371052335","label":"Remote Data Engineer - 60713"},{"type":"people_also_viewed","href":"https://in..com/jobs/view/fbs-sr-analytics-engineer-at-capgemini-4351299922","jobId":"4351299922","label":"FBS SR Analytics Engineer"},{"type":"people_also_viewed","href":"https://in..com/jobs/view/remote-data-engineer-60713-at-turing-4371047377","jobId":"4371047377","label":"Remote Data Engineer - 60713"},{"type":"people_also_viewed","href":"https://in..com/jobs/view/azure-data-engineer-at-tvarit-4004931744","jobId":"4004931744","label":"Azure Data Engineer"},{"type":"people_also_viewed","href":"https://in..com/jobs/view/data-engineer-at-sourcingxpress-4359683137","jobId":"4359683137","label":"Data Engineer"},{"type":"people_also_viewed","href":"https://in..com/jobs/view/oci-data-integration-developer-at-weekday-ai-yc-w21-4371292661","jobId":"4371292661","label":"OCI Data Integration Developer"},{"type":"similar_search","href":"https://www..com/jobs/hadoop-developer-jobs","label":"Empleos de Desarrollador de Hadoop"},{"type":"similar_search","href":"https://www..com/jobs/senior-data-engineer-jobs","label":"Empleos de Ingeniero de Datos Senior"},{"type":"similar_search","href":"https://www..com/jobs/data-engineer-jobs","label":"Empleos de Ingeniero de datos"},{"type":"similar_search","href":"https://www..com/jobs/scala-developer-jobs","label":"Empleos de Desarrollador de Scala"...

We are seeking an experienced Data Integration Engineer for a short-term role with the opportunity for full-time employment for the right candidate. Show less [{"type":"people_also_viewed","href":"https://au..com/jobs/view/analytics-business-intelligence-engineer-at-megt-australia-ltd-4358455090","jobId":"4358455090","label":"Analytics & Business Intelligence Engineer"},{"type":"people_also_viewed","href":"https://au..com/jobs/view/senior-data-engineer-at-triniti-4360851214","jobId":"4360851214","label":"Senior Data Engineer"},{"type":"people_also_viewed","href":"https://au..com/jobs/view/senior-data-engineer-at-wesfarmers-health-4367074784","jobId":"4367074784","label":"Senior Data Engineer"},{"type":"people_also_viewed","href":"https://au..com/jobs/view/data-analyst-at-recoded-4360440270","jobId":"4360440270","label":"Data Analyst"},{"type":"people_also_viewed","href":"https://au..com/jobs/view/senior-data-engineer-azure-databricks-at-kaizen-global-technologies-4370244156","jobId":"4370244156","label":"Senio...

You will join a data engineering team that owns and manages customer data pipelines, consolidating data from multiple sources to support a variety of business and analytics use cases. Key Responsibilities Design, build, modernize, and maintain data pipelines using Azure, Databricks, Snowflake, and GCP Own customer data pipelines that ingest, transform, and consolidate data from multiple sources Create and publish secure Snowflake views for enterprise data sharing Migrate existing pipelines to Delta Live Tables (DLT) and implement Unity Catalog Deploy and manage pipelines using established CI/CD frameworks Ensure compliance with PII masking and encryption requirements Develop data solutions using SQL and Python (PySpark) Orchestrate workflows using Azure Data Factory, Airflow, and Fivetran Support streaming data workloads (Kafka, EventHub, Spark Streaming) Participate in DevOps activities, including: Improving CI/CD pipelines Monitoring production systems Troubleshooting and resolving failures Participating in on‑call rotations as needed Collaborate with global engineering teams in an Agile, DevOps, and SRE‑aligned environment Act as a role model for engineering excellence and support skill development across the team Required Skills & Experience 5+ years of experience in data or database engineering, building and deploying data pipelines (customer data experience strongly preferred) Strong hands‑on experience with Azure, including deployments, configurations, and Storage Accounts Proven experience with: Azure Data Factory Azure Databricks Snowflake DBT / Delta Live Tables (DLT) Medallion Architecture Strong Python skills, particularly PySpark, for building and optimizi...

Should have experience on Google Cloud Dataproc with data structures, data modeling, and software architecture. Show less [{"type":"people_also_viewed","href":"https://in..com/jobs/view/senior-data-engineer-at-mako-it-lab-4370658547","jobId":"4370658547","label":"Senior Data Engineer"},{"type":"people_also_viewed","href":"https://in..com/jobs/view/senior-data-engineer-at-harrison-ai-4368176180","jobId":"4368176180","label":"Senior Data Engineer"},{"type":"people_also_viewed","href":"https://in..com/jobs/view/senior-snowflake-data-engineer-at-epam-systems-4354264092","jobId":"4354264092","label":"Senior Snowflake...

• Translate business needs into detailed technical specifications and data models, collaborating with data architects and delivery teams. Domain - Banking and Finance Large scale data projects with AI implementation Strong expertise in requirement gathering, data mapping, and process optimization within data-centric environments.

You will schedule assignments, monitor, review and report project status regularly in order to manage project risks and ensure successful project delivery and implementation. Project Management fundamentals Project Lifecycles on development & maintenance projects, estimation methodologies, quality processes.

Stakeholder Engagement & Business Impact Work with cross-functional partners (Product, Engineering, Business, CXOs) and drive trusted advisor-style engagement. Review work products for statistical rigor and business relevance.

Must have experience in application / data warehouse modernization projects and creating new Big Data & Data Engineering solutions on public cloud platforms. Experience with AI , ML cloud offerings and solutions ( good to have) Demonstrated experience in conceptualizing and executing end-to-end data engineering solutions using Databricks/Spark for multiple large-scale data processing and integration projects.

Responsibilities You will collaborate with engineers, data scientists, subject matter experts, and customers in the full-stack implementation of data products for mortgage capital markets applications. You will help define and maintain derived data layers that support a collection of related analytics products.

Your Role And Responsibilities As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too.