All 194 questions
What is the difference between COPY INTO and Snowpipe in Snowflake?
Asked in 3 of 307 interviews · last asked Sep 20 · Concept · Mid-level
Show answer
COPY INTO loads staged files in batches using a virtual warehouse that you manage. Snowpipe loads new staged files continuously using Snowflake-managed compute, usually triggered by file notifications. Use COPY INTO for scheduled bulk loads and Snowpipe when fresh data should arrive with less delay.
- COPY INTO runs when you execute it or schedule it.
- Snowpipe uses a pipe object containing a COPY INTO statement.
- COPY INTO uses warehouse credits; Snowpipe has separate serverless ingestion charges.
- File-based Snowpipe is not instant row streaming; Snowpipe Streaming is a separate ingestion option.
What the interviewer checks: The interviewer checks whether you can choose a loading method based on timing, compute management, and cost.
Other ways it was asked
- “What's the difference between Snowpipe and the standard COPY INTO batch load?”
- “What is the difference between Snowpipe and COPY INTO in Snowflake?”
What is a staging area in Snowflake?
Asked in 2 of 307 interviews · last asked Sep 18 · Concept · Junior
Show answer
A staging area, or stage, in Snowflake is a location for data files before loading them into tables. An internal stage stores files in Snowflake-managed storage; an external stage points to supported cloud storage. COPY INTO loads data from staged files into a table.
- Internal stages can be user stages, table stages, or named stages.
- External stages point to Amazon S3, Google Cloud Storage, or Azure storage.
- Stages hold files, not database rows, and can also receive files exported from tables.
What the interviewer checks: The interviewer checks whether you understand stages, their types, and their role in loading data.
Other ways it was asked
- “What is staging in Snowflake?”
In Power Query, what's the practical difference between merge queries and append queries, and when would you use each?
Asked in 2 of 307 interviews · last asked Sep 6 · Tooling · Mid-level
Show answer
Merge joins tables using matching key columns, usually to add related columns. Append stacks rows from tables into one table. Use merge to add customer details to orders, and append to combine monthly sales tables with the same structure.
- Merge join types control which matching and unmatched rows are kept.
- Append matches columns by name, not position; missing columns get null values.
- Expanding a merge can increase row counts when a key has multiple matches.
- Append keeps duplicate rows; it does not remove them automatically.
What the interviewer checks: The interviewer checks whether you can choose between joining related data and stacking similar records.
Other ways it was asked
- “What is the difference between Append and Merge in Power Query?”
If business data is maintained manually in Excel or CSV files on SharePoint, how would you build a reliable reporting pipeline that handles changes to file structure or values?
Asked in 2 of 307 interviews · last asked Sep 29 · Scenario · Mid-level
Show answer
I would automatically copy SharePoint files into versioned storage, then validate them before loading reporting tables. I would agree on column names, data types, and value rules with the business owners. Invalid files would be held back and trigger an alert, keeping the last valid report available. Approved changes would update the pipeline and its tests.
- Keep original files and source versions so reports can be traced and rebuilt.
- Check required columns, types, duplicate keys, missing values, and allowed values.
- Use stable business keys to apply corrections without creating duplicates when files are processed again.
- Reconcile row counts and business totals; show the last successful refresh so stale reports are visible.
What the interviewer checks: The interviewer is checking whether you can turn manually maintained files into controlled, traceable reporting despite unexpected changes.
Other ways it was asked
- “Some operational data arrives in Excel or CSV files maintained by business users, perhaps through SharePoint. How would you bring it into a production reporting pipeline and make sure people can trust it?”
- “Tell me about a time you worked with data maintained in multiple CSV files on SharePoint because it wasn’t captured in a core system. What problem did it cause, what did you change, and how did you make the resulting reporting trustworthy?”
- “If business data is maintained manually in Excel or CSV files on SharePoint, how would you bring it into a reliable reporting pipeline? Tell me about your experience with this kind of data and what you did when the file structure or values changed.”
What does POE mean in satellite orbit data processing, and how is it used?
Asked once · last asked Sep 22 · Concept · Mid-level
Other ways it was asked
- “What does POE mean in satellite orbit data processing?”
- “What role does POE play in satellite orbit data processing?”
How would you map platform-specific identifiers to a normalized campaign ID?
Asked once · last asked Jul 20 · Design · Mid-level
Other ways it was asked
- “How would you map platform-specific identifiers, such as Facebook campaign IDs or Google objective IDs, to a normalized campaign ID?”
Why might Amazon S3 be used as an intermediary between AWS Lambda and Snowflake, and how would you integrate it?
Asked once · last asked Sep 20 · Design · Mid-level
Other ways it was asked
- “Why might you use Amazon S3 as an intermediary between AWS Lambda and Snowflake?”
- “Why might you use Amazon S3 as an intermediary instead of loading data directly from AWS Lambda into Snowflake?”
- “How would you set up data ingestion between AWS Lambda, Amazon S3, and Snowflake?”
When writing data to Iceberg with Spark, what is the difference between overwrite and dynamic partition overwrite?
Asked once · last asked Aug 6 · Concept · Mid-level
Other ways it was asked
- “When writing to an Iceberg table with Spark using dynamic partition overwrite, what happens if the input data contains multiple partitions?”
What novel approaches would you consider when building a data enrichment platform?
Asked once · last asked Aug 6 · Behavioral · Senior
Other ways it was asked
- “What novel approaches did you use to build a data enrichment platform?”
Write a PySpark script to read CSV from ADLS, remove records with missing values in a specified column, group by another column to calculate an average, and write the results to a Delta Lake table in ADLS with schema enforcement and partitioning.
Asked once · last asked Aug 11 · Write code · Mid-level
Other ways it was asked
- “Can you write a PySpark script that reads a CSV file from Azure Data Lake Storage, filters out records where a specific column has no values, groups the data by a given column to calculate the average of another column, and writes the transformed data back to a Delta Lake table in ADLS with schema enforcement and partitioning?”
- “Can you write a PySpark script that reads a CSV file from Azure Data Lake Storage, filters out empty values, groups the data by a column to calculate an average, and writes the results to Delta Lake with schema enforcement and partitioning?”
How would you approach ingesting and processing a batch of JSON files from Azure Data Lake in Databricks, including Delta Lake, partitioning, and performance optimization?
Asked once · last asked Aug 22 · Design · Senior
Other ways it was asked
- “How would you use Databricks to ingest and process a batch of JSON files stored in an Azure Data Lake, ensuring data quality and proper partitioning for efficient querying?”
In what scenarios would you use dataflows in Power BI?
Asked once · last asked Aug 28 · Tooling · Mid-level
What is the difference between a replication flow and a transformation flow in SAP Datasphere, and how would you decide which to use?
Asked once · last asked Aug 28 · Concept · Mid-level
Other ways it was asked
- “What is the difference between a replication flow and a transformation flow in SAP Datasphere, and which one would you use for this scenario?”
- “How would you use a replication flow or transformation flow to filter data in SAP Datasphere?”
How would you connect an external website to a chatbot and provide the website's data to it?
Asked once · last asked Sep 30 · Design · Mid-level
Other ways it was asked
- “How would you integrate an external company website with a chatbot so the bot can use the website's data?”
What is the standard CDS view used to extract ACDOCA into SAP Datasphere?
Asked once · last asked Sep 30 · Concept · Mid-level
Other ways it was asked
- “How do you manage and extract data from the standard CDS view for ACDOCA into SAP Datasphere?”
If your organization uses ServiceNow HRSD and an external payroll system, how would you integrate the two to ensure seamless data flow for employee payroll information?
Asked once · last asked Oct 22 · Scenario · Senior
Other ways it was asked
- “How would you integrate ServiceNow HRSD with an external payroll system while addressing security, data consistency, and error handling?”
When you receive a new dataset, what steps do you take to clean and prepare it?
Asked once · last asked Jan 26 · Scenario · Junior
What kinds of batch and real-time integrations can Apache NiFi support, and how would you implement them?
Asked once · last asked Feb 6 · Tooling · Mid-level
Which Apache NiFi processors would you use to read a 4-GB file from SFTP in batches and send the processed data to a target system?
Asked once · last asked Feb 6 · Tooling · Mid-level
How would you integrate data from manufacturing execution systems (MES), and what platform-specific considerations would you account for?
Asked once · last asked Feb 10 · Behavioral · Mid-level
Other ways it was asked
- “Tell me about your experience with manufacturing execution systems (MES), including platforms you have used and how you have integrated their data.”
How do you create a Kafka Connect connector?
Asked once · last asked Feb 18 · Tooling · Mid-level
How do you integrate SAP ERP data into Power BI dashboards?
Asked once · last asked Feb 24 · Tooling · Mid-level
What tools, libraries, or frameworks can you use to ingest PDF documents into a RAG system?
Asked once · last asked Mar 16 · Tooling · Mid-level
What data-loading patterns do you know for loading raw data into a warehouse?
Asked once · last asked Mar 20 · Concept · Mid-level
If the source has only one record but the Normalizer’s occurs value is set to four, what will the output be?
Asked once · last asked Apr 12 · Scenario · Junior
If the input contains 20 records across four departments, with five records per department, and is sorted by department, but Group By is not enabled for the department in the Aggregator, what output will it produce?
Asked once · last asked Apr 12 · Scenario · Junior
What happens if Sorted Input is enabled in the Aggregator?
Asked once · last asked Apr 12 · Concept · Junior
Given an employee DataFrame with name, reference ID, and salary columns, how would you split the reference ID into ID and location components, map location codes such as CHN to full names, and output reference ID, salary, and location columns?
Asked once · last asked Apr 14 · Write code · Junior
Other ways it was asked
- “Given an employee DataFrame with name, reference ID, and salary columns, split the reference ID into its ID and location components, map location codes such as CHN to their full names, and produce an output with reference ID, salary, and location columns.”
If you were ingesting data from a REST API, how would you design the ingestion, and what would your thought process be?
Asked once · last asked Apr 17 · Design · Senior
How would you securely extract and evaluate information from a large PDF corpus for AI agents, comparing AWS or GCP tools, Palantir Foundry, and private cloud to right-size the architecture for a customer?
Asked once · last asked Apr 20 · Design · Senior
Other ways it was asked
- “How would you securely and accurately extract information from a large PDF corpus, evaluate the results, and make the information available to AI agents? How would you compare AWS or GCP tools, Palantir Foundry, and private cloud when right-sizing the architecture for a customer?”
If I gave you a PDF and asked you to extract its information and put it into a vector database, what techniques would you use?
Asked once · last asked Apr 20 · Scenario · Mid-level
How do you retrieve data from an API and validate the response?
Asked once · last asked Apr 24 · Tooling · Mid-level
When retrieving data from an API with Python, how do you handle pagination, authentication tokens, and rate limits?
Asked once · last asked Apr 24 · Tooling · Mid-level
How would you import 20,000 contact records into a model-driven app?
Asked once · last asked Apr 24 · Scenario · Mid-level
What options are available for automatically feeding data into a CRM system every two or three days instead of importing it manually?
Asked once · last asked Apr 24 · Scenario · Mid-level
How would you design a document-processing workflow that extracts and embeds a user's document, then determines eligibility based on its contents?
Asked once · last asked May 12 · Design · Mid-level
How would you update an AI system when a site's shutdown procedures change?
Asked once · last asked May 13 · Scenario · Senior
How would you map customers_src (customer ID, name, country) to warehouse table customers_dim (customer key, customer ID, name, country, is_active), including logic for populating customer keys and is_active and handling new versus existing customers?
Asked once · last asked May 18 · Scenario · Mid-level
Other ways it was asked
- “Suppose you have a source table called customers_src and a target table called customers_dim in a data warehouse. The target requires customer key, customer ID, name, country, and is_active, but the source provides only customer ID, name, and country. How would you design a simple mapping and logic to populate the target table, including handling new versus existing customers?”
You receive event data in JSON format, with each record containing a user ID, event type, and metadata such as page and device. How would you parse the JSON structure to extract the user ID, event type, and page for further processing?
Asked once · last asked May 18 · Scenario · Junior
System logs often contain fields such as timestamp, log level, and message. How would you design a simple approach to parse log lines and store them in a structured format for analysis?
Asked once · last asked May 18 · Scenario · Junior
How would you use Python to parse system log lines, extract timestamps, log levels, and messages, and store the results in a structured format?
Asked once · last asked May 18 · Scenario · Junior
When pulling SEC EDGAR filings at scale, how do you reliably retrieve the correct exhibits across amended filings—for example, 10-K versus 10-Q/A—while keeping a clear audit trail of what you downloaded and why?
Asked once · last asked May 23 · Scenario · Senior
When preparing data for database insertion, how would you clean it, and what anomalies would you look for?
Asked once · last asked May 26 · Scenario · Junior
Besides APIs, what methods can you use to obtain data from external sources, such as websites?
Asked once · last asked May 26 · Concept · Mid-level
Write PySpark code to fetch a JSON file from S3, flatten its data, and insert it into a table.
Asked once · last asked May 27 · Write code · Mid-level
What is the most efficient way to compare related datasets from Excel and a SharePoint list and update SharePoint when there are more than 20,000 records?
Asked once · last asked Jun 9 · Scenario · Senior
How would you automatically make a newly uploaded job description available to an AI agent?
Asked once · last asked Jun 9 · Design · Senior
How would you process PDF, DOCX, and Excel files for a RAG system, and would you chunk each format?
Asked once · last asked Jun 12 · Scenario · Mid-level
How would you design a Spark ingestion and curation framework in PySpark, and how would you define its target?
Asked once · last asked Jun 15 · Design · Senior
How would you structure a PySpark AWS Glue job, starting with its first five lines, to read a raw JSON file from S3 containing a nested array field, deduplicate records on a composite key, and write the result?
Asked once · last asked Jun 19 · Write code · Mid-level
Other ways it was asked
- “Walk me through the PySpark code structure for an AWS Glue job that reads a raw JSON file from S3 with a nested array field, deduplicates records on a composite key, and writes the result. What are the first five lines of the job?”
How would you acquire and integrate data from 14 different products?
Asked once · last asked Jun 22 · Design · Senior
When would you relationalize XML data in a data pipeline, and how would you do it?
Asked once · last asked Jun 22 · Concept · Mid-level
How do you perform time travel on Apache Iceberg tables?
Asked once · last asked Jun 23 · Tooling · Mid-level
How would you integrate data from multiple sources using ETL or ELT to ingest, transform, and deliver data from different systems or APIs?
Asked once · last asked Jun 24 · Design · Mid-level
Other ways it was asked
- “How did you integrate data from multiple sources? What was your approach to ETL or ELT, and how did you ingest, transform, and deliver data from different systems or APIs?”
How would you integrate at least two sources, such as databases, APIs, or external files, into an analytics platform while ensuring consistency and handling differences in data formats or schemas?
Asked once · last asked Jun 24 · Design · Mid-level
Other ways it was asked
- “Can you give an example of integrating at least two sources, such as databases, APIs, or external files, into your analytics platform? How did you ensure consistency and handle differences in data formats or schemas?”
How would you use SSIS to build data pipelines and stage data?
Asked once · last asked Jun 25 · Tooling · Mid-level
In Oracle, what's the practical difference between DELETE and TRUNCATE, and when would you choose one over the other in an ETL load pattern?
Asked once · last asked Jun 25 · Concept · Mid-level
How would you merge real estate records using SSNs or another matching method?
Asked once · last asked Jul 16 · Scenario · Senior
How would you extract and process images embedded in PDF documents for an LLM application?
Asked once · last asked Jul 16 · Scenario · Mid-level
How would you clean data and transform it from an unstructured format into a structured one?
Asked once · last asked Jul 16 · Scenario · Mid-level
How would you build a bot that gathers news from multiple sources and sends it to Telegram, Zalo, and Facebook?
Asked once · last asked Jul 16 · Design · Mid-level
How would you handle news sources that do not allow their data to be retrieved?
Asked once · last asked Jul 16 · Scenario · Mid-level
How can incoming invoices be imported and classified to determine whether a client is eligible for tax credits?
Asked once · last asked Jul 16 · Case · Mid-level
How would you extract information from PDFs and structure the extraction pipeline so an AI model can consume it?
Asked once · last asked Jul 17 · Design · Mid-level
Would you choose an AI model or a library for PDF data extraction, and what limitations would you expect from each approach?
Asked once · last asked Jul 17 · Scenario · Senior
In a PDF with inline images, would you keep the image data at the same point in the document or reference it elsewhere, and how would that affect accuracy and latency?
Asked once · last asked Jul 17 · Design · Senior
If a PDF contains charts like pie charts, line charts, or heat maps, would OCR still work, and how would you handle that case?
Asked once · last asked Jul 17 · Scenario · Mid-level
How would you design an ingestion pipeline that syncs product data into a vector database for concurrent uploads?
Asked once · last asked Jul 20 · Design · Senior
Would you pass each record retrieved from a third-party platform through the normalizer individually or process records in batches?
Asked once · last asked Jul 20 · Design · Mid-level
Would you process records from a third-party platform individually or in batches, and what would you write to Kafka first?
Asked once · last asked Jul 20 · Design · Mid-level
How would you normalize data from different platforms into a consistent format?
Asked once · last asked Jul 20 · Design · Mid-level
Where in a data pipeline would you apply custom classification logic for client-defined fields?
Asked once · last asked Jul 20 · Design · Senior
How would you apply an update to custom classification logic to events already stored in a normalized database?
Asked once · last asked Jul 20 · Design · Senior
How would you design an extraction component for a luxury real estate catalog platform?
Asked once · last asked Jul 27 · Design · Mid-level
Other ways it was asked
- “For a luxury real estate catalog, what information would you pass to an extraction component, and what inputs would it process?”
What is web scraping, and what kind of data can usually be extracted from websites?
Asked once · last asked Jul 28 · Concept · Junior
Imagine you need to scrape a new website. What main steps would you take from checking the website to saving structured data?
Asked once · last asked Jul 28 · Scenario · Mid-level
When inspecting a new website's network requests for scraping, what do you look for?
Asked once · last asked Jul 28 · Tooling · Mid-level
Which libraries and techniques can you use to retrieve satellite imagery?
Asked once · last asked Aug 3 · Tooling · Mid-level
In OAI-PMH, what are the entities involved, and what roles do data providers and service providers play?
Asked once · last asked Aug 3 · Concept · Mid-level
How would you implement a metadata harvesting service using OAI-PMH?
Asked once · last asked Aug 3 · Design · Mid-level
What must a data provider do to comply with OAI-PMH?
Asked once · last asked Aug 3 · Concept · Mid-level
How would you unify four different data sources into a normalized advertising schema?
Asked once · last asked Aug 5 · Design · Senior
How do you choose vendors for waterfall data enrichment, and how do you handle conflicting results?
Asked once · last asked Aug 7 · Scenario · Senior
Other ways it was asked
- “How do you decide the order in which vendors are used in a waterfall data enrichment process?”
How can a data enrichment system work without third-party vendors, and what technologies might support it?
Asked once · last asked Aug 7 · Design · Senior
How would you design an Azure Data Factory flow to consolidate large datasets from Azure SQL Database and Blob Storage, with differing schemas and data types, into one Azure Data Lake file while handling schema mapping, schema drift, scalability, and performance?
Asked once · last asked Aug 10 · Design · Senior
Other ways it was asked
- “You are tasked with creating a solution in Azure Data Factory to move data from multiple sources, including Azure SQL database and Blob storage, into a single consolidated file in Azure Data Lake. The data sources vary in schema and data types. How would you design the data flow to handle schema mapping, ensure scalability, and optimize performance for processing large datasets? Additionally, how would you handle schema drift during this process?”
How would you map columns between datasets with completely different structures in Azure Data Factory, and ensure data type compatibility during transformations?
Asked once · last asked Aug 10 · Scenario · Mid-level
Other ways it was asked
- “To simplify this further, if you have two datasets in Azure Data Factory, one containing sales data and another containing customer demographic data, both with different schemas, how would you map the columns between these datasets to create a unified schema while ensuring correct data types? Please provide an example of handling a mismatched data type during this process.”
How would you map columns with different data types, such as a string column to a numeric column, in Azure Data Factory, and prevent invalid data from disrupting the pipeline?
Asked once · last asked Aug 10 · Scenario · Mid-level
How would you design an Azure Data Factory pipeline to ingest multiple JSON files from Azure Blob Storage, parse nested structures, extract selected fields, and flatten them into an Azure SQL Database table while handling schema drift, performance, and data consistency?
Asked once · last asked Aug 10 · Design · Senior
Other ways it was asked
- “You are working on an Azure Data Factory pipeline that ingests data from multiple JSON files stored in Azure Blob Storage. The pipeline needs to parse nested JSON structures, extract specific fields, and transform the data into a flattened schema before writing it into an Azure SQL database table. How would you design this pipeline? Include details on handling schema drift, optimizing performance, and ensuring data consistency during the process.”
How would you configure an Azure Data Factory mapping data flow to extract nested JSON fields while preserving records when some fields are missing or null?
Asked once · last asked Aug 10 · Tooling · Mid-level
Other ways it was asked
- “How would you configure the explode_outer operation in an Azure Data Factory mapping data flow to extract nested JSON fields, including when some fields are missing or null?”
How would you split a full name into first, middle, and last names when some rows have no middle name?
Asked once · last asked Aug 14 · Scenario · Mid-level
Marketers give you a table of 10,000–100,000 users, with phone numbers spread across different columns, and need a mailing list prepared. How would you handle it?
Asked once · last asked Aug 14 · Scenario · Mid-level
How can you design a generic Azure Data Factory pipeline to fetch data from 200 SQL tables and load it into ADLS?
Asked once · last asked Aug 15 · Design · Mid-level
How would you use Azure Data Factory to copy files from a temporary folder to a raw folder only when they contain records?
Asked once · last asked Aug 20 · Tooling · Mid-level
How would you use Azure Data Factory to read only the CSV files from a folder of thousands of mixed-format files in ADLS and merge them into a single CSV?
Asked once · last asked Aug 20 · Tooling · Mid-level
How would you use the wildcard file path in the Copy Data activity to handle multiple CSV files?
Asked once · last asked Aug 20 · Tooling · Mid-level
How would you design an API integration to transfer three billion rows of daily production data to an insurance information center?
Asked once · last asked Aug 22 · Design · Senior
How do you engineer data ingestion to supply real-time feature context to ML models while handling data drift, schema changes, or high concurrency?
Asked once · last asked Aug 25 · Design · Senior
How would you preprocess data for batch jobs using data scrubbers?
Asked once · last asked Aug 27 · Concept · Mid-level
Can you explain what pivot is in Power BI, with a before and after example?
Asked once · last asked Aug 28 · Tooling · Junior
When unpivoting data in Power BI, which columns do you keep as identifiers?
Asked once · last asked Aug 28 · Tooling · Mid-level
How can you connect SAP S/4HANA to Snowflake, and what source data options are available?
Asked once · last asked Aug 28 · Scenario · Senior
Why might you use Python automation to write data directly to Amazon S3 instead of SAP Datasphere's native functionality?
Asked once · last asked Aug 28 · Scenario · Senior
Can SSIS integrate only with SQL Server, or can it work with other kinds of databases as well?
Asked once · last asked Aug 29 · Concept · Mid-level
When would you use Python transformations instead of implementing the logic in SQL?
Asked once · last asked Aug 29 · Concept · Mid-level
How would you use AI to consolidate product issues reported in multiple languages into a single language?
Asked once · last asked Sep 1 · Scenario · Mid-level
Can you list the key transformations in Informatica?
Asked once · last asked Sep 1 · Concept · Junior
How would you approach structuring and designing a CSV importer that handles varying file sizes and mappings?
Asked once · last asked Sep 2 · Design · Senior
How do you bring a CSV file from a shared location into GCS and load it into BigQuery?
Asked once · last asked Sep 3 · Tooling · Mid-level
How would you build a PDF-to-chat application, from processing multiple PDFs through storing the data and generating chat responses?
Asked once · last asked Sep 4 · Design · Senior
When you merge two tables in Power Query, what join types can you choose, and how do you decide which one fits a report requirement?
Asked once · last asked Sep 6 · Tooling · Mid-level
How would you flatten deeply nested JSON using Spark?
Asked once · last asked Sep 7 · Tooling · Mid-level
How would you prepare data in Power Query to build an effective Power BI dashboard?
Asked once · last asked Sep 9 · Tooling · Junior
How can you configure a BigQuery ingestion pipeline to ensure logs older than 45 days are removed?
Asked once · last asked Sep 9 · Tooling · Mid-level
How would you copy data from a source system to a Google Cloud Storage (GCS) bucket?
Asked once · last asked Sep 10 · Tooling · Mid-level
How would you read pipe-delimited files and use an efficient SQL join to find employees with the third-highest salary in each department?
Asked once · last asked Sep 10 · Write code · Mid-level
Other ways it was asked
- “How would you read pipe-delimited files and use an efficient SQL join to find the third-highest salary in each department?”
When integrating non-CRM tools with a CRM, how do you map data flows and resolve records that do not match?
Asked once · last asked Sep 14 · Scenario · Mid-level
When integrating Salesforce with HubSpot, how would you choose between a native connector, middleware, or API and handle conflicts when the same field changes in both systems?
Asked once · last asked Sep 14 · Behavioral · Senior
Other ways it was asked
- “When you integrated Salesforce with HubSpot, what mechanism moved the data—native connector, middleware, or API—and how did you handle conflicts when the same field changed in both systems?”
What results does a left anti merge return?
Asked once · last asked Sep 15 · Concept · Junior
What is fuzzy matching when doing joins?
Asked once · last asked Sep 15 · Concept · Junior
How would you ingest an Avro payload from Kafka into Snowflake?
Asked once · last asked Sep 16 · Scenario · Senior
What preprocessing steps are typically performed in the silver layer of a medallion architecture?
Asked once · last asked Sep 17 · Concept · Mid-level
What is the difference between a stage and Snowpipe in Snowflake?
Asked once · last asked Sep 17 · Concept · Mid-level
How would you design a pipeline to ingest 500 CSV files per day from S3 into a Snowflake table?
Asked once · last asked Sep 17 · Design · Senior
What technical challenges can arise when integrating different data sources into Power BI dashboards, and how would you address them?
Asked once · last asked Sep 17 · Tooling · Mid-level
What preprocessing operations can be performed on data in the bronze layer of the Databricks medallion architecture?
Asked once · last asked Sep 18 · Concept · Mid-level
How do you load dimension and fact tables in Snowflake using a star schema?
Asked once · last asked Sep 19 · Tooling · Mid-level
How would you extract data from SAP or another ERP platform for analytics?
Asked once · last asked Sep 20 · Tooling · Mid-level
How does Snowpipe work, and how would you use it to load data?
Asked once · last asked Sep 20 · Tooling · Mid-level
For a client ETL integration, when should the client provide a file in a specified format versus build their own ETL scripts?
Asked once · last asked Sep 21 · Scenario · Mid-level
Write simple code to flatten a JSON file and print its schema.
Asked once · last asked Sep 21 · Write code · Junior
How do you approach integrating disparate enterprise systems like HR, finance, and inventory?
Asked once · last asked Sep 21 · Design · Senior
How do you get Oracle Fusion data into an ATP database?
Asked once · last asked Sep 21 · Tooling · Mid-level
Other ways it was asked
- “For integrating thousands of Oracle Fusion records into an ATP database, which approach would you prefer?”
How should data be handled between collection and input to a machine-learning model?
Asked once · last asked Sep 22 · Concept · Junior
What options are available for ingesting data into Snowflake without AWS, using Snowflake's own ecosystem?
Asked once · last asked Sep 22 · Concept · Mid-level
How would you build a production PySpark pipeline, from source data to final output, including transformations, joins, aggregations, and the PySpark APIs you would use?
Asked once · last asked Sep 23 · Tooling · Senior
Other ways it was asked
- “Can you walk me through one production PySpark pipeline you personally developed, starting from the source data and explaining the transformations, joins, aggregations, final output, and PySpark APIs used?”
Which connections can you create or use in SAP Datasphere before building data models?
Asked once · last asked Sep 24 · Concept · Mid-level
When would you use data replication versus a live connection in SAP Datasphere?
Asked once · last asked Sep 24 · Concept · Senior
What transformation options are available in SAP Datasphere, and how do they differ?
Asked once · last asked Sep 24 · Concept · Mid-level
How would you ingest and classify issue reports in a diagnostic system?
Asked once · last asked Sep 25 · Design · Senior
How would you extract data from SharePoint?
Asked once · last asked Sep 28 · Tooling · Mid-level
A shipment arrives late Monday, but its WMS record arrives just after midnight Tuesday; which timestamp would you use to match it to a daily capacity snapshot, and how would you handle snapshots that record only end-of-day capacity?
Asked once · last asked Sep 28 · Scenario · Senior
Other ways it was asked
- “A shipment arrives late on Monday, but its WMS record is received just after midnight on Tuesday. Which timestamp would you use to match the shipment to the daily capacity snapshot, and what would you do if the snapshot only records capacity at the end of each day?”
How do you use extraction logic to ingest data into SAP Datasphere?
Asked once · last asked Sep 30 · Tooling · Senior
Other ways it was asked
- “How do you handle delta extraction in SAP Datasphere?”
How would you extract all instance IDs from a nested AWS API response in JSON?
Asked once · last asked Sep 30 · Write code · Junior
What tools or technologies can you use to transform data after loading it into BigQuery?
Asked once · last asked Oct 2 · Concept · Mid-level
How would you load data from Azure Blob Storage into Databricks?
Asked once · last asked Oct 7 · Tooling · Mid-level
Which integration runtime would you use to copy data from Blob Storage to Databricks?
Asked once · last asked Oct 7 · Scenario · Mid-level
How would you use Kafka to handle the transfer of thousands of files within a short period?
Asked once · last asked Oct 7 · Scenario · Senior
Other ways it was asked
- “How would Kafka handle thousands of files arriving within a short period?”
How do you integrate external data with the CMDB?
Asked once · last asked Oct 7 · Tooling · Mid-level
How would you create an ontology layer with business knowledge derived from multiple sections of a PDF document, including formulas or calculations?
Asked once · last asked Oct 12 · Design · Senior
How would you get CMDB data from an Oracle database inside the organization’s network into the ServiceNow cloud platform?
Asked once · last asked Oct 13 · Scenario · Senior
How would you import Excel records into ServiceNow so that matching user IDs are updated, while non-matching records are ignored and no new records are inserted?
Asked once · last asked Oct 13 · Scenario · Mid-level
How can receipt data from a front end be transferred into an AS/400 system?
Asked once · last asked Oct 15 · Concept · Mid-level
How would you build a small data pipeline to remove duplicate records and retrieve the most recent customer to make a purchase?
Asked once · last asked Oct 19 · Write code · Mid-level
When preparing data for exploratory analysis, how do you collect and preprocess it, select relevant sources or tables, and handle missing or inconsistent values?
Asked once · last asked Oct 19 · Scenario · Junior
How would you build automated data ingestion and transformation for a distributed lead-generation platform?
Asked once · last asked Oct 21 · Design · Mid-level
Other ways it was asked
- “What data sources might a lead-generation platform ingest, and how would you process and transform that data automatically?”
Can you walk me through what happens from the moment a user uploads a PDF document to the application?
Asked once · last asked Oct 22 · Design · Mid-level
How should a web crawler handle a standard link, an email address, a phone number, and an image link found on a page?
Asked once · last asked Oct 23 · Scenario · Mid-level
How should a web crawler handle internal links differently from external links, such as links to Instagram or LinkedIn?
Asked once · last asked Oct 23 · Concept · Mid-level
How do you fetch data from the bronze layer to the silver layer?
Asked once · last asked Aug 25 · Scenario · Mid-level
Other ways it was asked
- “How do you load the latest or updated data from the bronze layer to the silver layer?”
Show an example of what a table might look like before it is unpivoted in Power BI.
Asked once · last asked Aug 28 · Tooling · Junior
What is the M language in Power Query, and when would you use it?
Asked once · last asked Feb 27 · Concept · Mid-level
Which transformation is used to convert columns to rows?
Asked once · last asked Apr 12 · Concept · Junior
Can you give an example of how a Normalizer transformation works?
Asked once · last asked Apr 12 · Concept · Junior
What is a data load process?
Asked once · last asked Apr 14 · Concept · Junior
What is EDIFACT, and when would you use it?
Asked once · last asked Apr 24 · Concept · Mid-level
How would you extract text from PDF files?
Asked once · last asked Jun 12 · Tooling · Mid-level
Other ways it was asked
- “How did you extract text from the PDFs?”
Why might you convert Excel files to PDF for processing, and what role can pandas play in a document-processing pipeline?
Asked once · last asked Jun 12 · Tooling · Mid-level
How does data typically move into Snowflake from a lakehouse architecture?
Asked once · last asked Jul 16 · Concept · Mid-level
What is a document loader?
Asked once · last asked Nov 20 · Concept · Junior
What is the difference between data cleaning and data transformation?
Asked once · last asked Jul 17 · Concept · Junior
What limitations of PDF libraries can you think of right away?
Asked once · last asked Jul 17 · Concept · Mid-level
How would you parse satellite image data for a computer vision project?
Asked once · last asked Aug 3 · Scenario · Mid-level
What is Databricks Auto Loader?
Asked once · last asked Aug 11 · Concept · Junior
Other ways it was asked
- “What is Auto Loader?”
How do you implement data transformations in Databricks?
Asked once · last asked Aug 19 · Tooling · Mid-level
How do you identify and integrate data sources into a data platform?
Asked once · last asked Aug 26 · Scenario · Mid-level
How do you unpivot columns in Power BI?
Asked once · last asked Aug 28 · Tooling · Junior
When merging consecutive turns in diarized transcript data, should grouping be based on the text or the speaker label?
Asked once · last asked Aug 28 · Concept · Mid-level
After designing a CSV import pipeline with background jobs, validation, error reporting, and progress feedback, what additional capability might users request next?
Asked once · last asked Sep 2 · Scenario · Mid-level
When importing a CSV file into a data workflow, what steps do you take beyond the import itself?
Asked once · last asked Sep 3 · Scenario · Mid-level
How would you extract and move data from a database?
Asked once · last asked Sep 3 · Scenario · Mid-level
How would you read data directly from a database rather than using an API?
Asked once · last asked Sep 3 · Scenario · Mid-level
What sources could provide students' marks for an AI chatbot that gives personalized recommendations?
Asked once · last asked Sep 5 · Scenario · Mid-level
What is Tableau Prep, and why do we need it?
Asked once · last asked Sep 9 · Concept · Junior
How would you read and ingest a file received from an external party into a data pipeline?
Asked once · last asked Sep 9 · Scenario · Mid-level
What would you configure in a data pipeline to fetch files from an external system?
Asked once · last asked Sep 9 · Scenario · Mid-level
What tools or utilities can you use to fetch files from an external system?
Asked once · last asked Sep 9 · Tooling · Mid-level
Can you explain a simple data pipeline that reads a file from a source and loads its data into BigQuery?
Asked once · last asked Sep 9 · Design · Mid-level
Other ways it was asked
- “Can you explain a simple data pipeline from reading a file from a source and loading the data into BigQuery?”
How would you use a Python script to process data, format files, or change file configurations in a data pipeline?
Asked once · last asked Sep 9 · Tooling · Mid-level
How do you use Google Cloud Dataflow to process data?
Asked once · last asked Sep 10 · Tooling · Mid-level
What is Snowpipe?
Asked once · last asked Sep 18 · Concept · Junior
How do you interface with sensors to collect data?
Asked once · last asked Sep 22 · Design · Mid-level
How do you manage manual data within an organization?
Asked once · last asked Sep 28 · Scenario · Mid-level
How would you provide data to a chatbot?
Asked once · last asked Sep 30 · Design · Mid-level
How would you load cleaned data into a data warehouse?
Asked once · last asked Oct 18 · Scenario · Mid-level
More ETL and Data Pipelines interview questions
- All ETL and Data Pipelines interview questions
- ETL Basics and Data Pipeline Architecture Interview Questions
- Dbt Interview Questions
- Data Pipeline Orchestration and Deployment Interview Questions
- Incremental Loading, CDC, and Streaming Interview Questions
- ETL Data Quality and Validation Interview Questions
- Data Pipeline Performance Optimization Interview Questions
- Data Pipeline Monitoring and Troubleshooting Interview Questions
- Data Migration Interview Questions
How this list is made
Every question here was asked by a real interviewer in a real job interview that a candidate ran MeetAssist in. After the call, the interviewer's questions are pulled from the transcript. Practice sessions, tests, exams and anything that was not a job interview are dropped.
Questions are rewritten so they make sense on their own: names of people, employers and clients are removed, and speech-to-text mistakes are fixed. Small talk, logistics and questions about one candidate's own résumé are left out. Rephrasings of the same question are merged, and the count is the number of different interviews it came up in.
The interviews come from candidates who use MeetAssist, so they lean towards software, data and AI roles: the shares describe these interviews, not every ETL and Data Pipelines interview. Answers to the most asked questions are written and checked by an editor; a "common mistake" is shown only when reviews of real answers in these interviews show it, with the count.
307 interviews, 169 candidates, Nov 2025 to Oct 2026. Updated every month with new interviews.
Or add the Chrome extension