Explore Big Data on Experts Exchange

Expert Solutions for Your Tech Problems

Big Data

Big data describes data sets that are so large or complex that traditional data processing applications are inadequate. Challenges include analysis...

Read more
  • 192 Content
  • 203 Contributors

Expert Spotlight
Senior .NET/Azure Developer/Analyst Consultant

Senior technical systems architect/ analyst and developer/mentor with over 30 years’ experience (20+ years in Canada)

Troubleshooting Question

What is the most efficient way to process large SAS datasets in Python and create .txt or .csv files?

3

Hello, I am trying to figure out the most efficient way to read and process SAS datasets in Python.

Research Question

PostgreSQL on cloud and big data deployment

10

hi,


recently I can see more and more cloud related big data project on PostgreSQL, any reason about

Advice Question

Why need data warehouse

2
Hi Experts,
I need to convince  higher level management why need to build data warehouse reason is …
Troubleshooting Question

Data fetching from www.mca.gov.in

22
i am having CIN of 100 company and i want ro extract data of 100 company on the portal of MCA ( …
Troubleshooting Question

SQL Server to Big data - need advice on architecture change or options

bywebsss
12
We use SQL server 2017 as our main data store RDMS

We have a vehicle tracking app with one …
Troubleshooting Question

Recursive Query in Hive

byRink k
3
Hi ,

Could please some help to write Recursive Query in Hive (or in Pyspark) .



Troubleshooting Question

How to run INSERT/UPDATE SQL Statement in HIVE SQL (HQL)

byRink k
1
Hi ,
 
      Looking to convert below SQL (INSERT and UPDATE ) statement into Hive Query Language…
Troubleshooting Question

Publish to Power BI Pro (online) with Power BI Desktop

I would like to know if we can publish to Power BI service (Pro) by using Power BI Desktop ?
Troubleshooting Question

Porting Python(pandas) program into spark environment

bysenksv
1
Would like to understand whether pandas(python) can be used to convert from oracle pl/sql to …
Troubleshooting Question

How to market a technology services company in the UK and US markets? Marketing question (which classifieds, or what marketing processes)

2
I have a relatively new company in the UK and it's a technology business that offers custom software…
Troubleshooting Question

Real-time analytics: What do companies want from Complex Event Processor that they don't have with Spark?

Why do companies purchase a product known as Complex Event Processor (TIBCO Streambase CEP, IBM …
Troubleshooting Question

API data as a stream to Google Pub Sub

1
I have a public API endpoint that I am pulling a json file every 30 mins. Right now I am using a …
Troubleshooting Question

Need for GlusterFS for distributed bigdata services running in a kubernetes managed environment

1
Hello.. what type of storage architecture would be most useful for kafka, zookeeper running in a …
Troubleshooting Question

Problem storing Kinesis data on S3 and DynamoDB

1
Hi, I'm building a big data streaming pipeline that takes streams from a camera through kinesis to …
Troubleshooting Question

How to improve AI gender identification accuracy?

1
I’m trying to crack my head around another key challenge at the moment. That is to Increase
AI’s …
Troubleshooting Question

How to improve AI age identification accuracy?

1
I’m trying to crack my head around a key challenge at the moment. That is to increase
AI’s accuracy…
Troubleshooting Question

Unable to Store Results from Hive Hadoop Script

1
Hello Experts,

I have created the following Hadoop Hive Script.

The script is attempting to …
Troubleshooting Question

Hadoop Hive ParseException Error Help

1
Hello Experts,

I have run a hql called samplehive.hql, see attached. However, the script fails …
Troubleshooting Question

What are the implications of renaming existing item codes to new codes in Oracle Inventory

2
My business is exploring the option of recoding item codes as currently its all over the place. …
Troubleshooting Question

YARN memory allocation

bymokkan
1
Hello,

I am new to Hadoop.  I have a question regarding yarn memory allocation.  If  we have …

Do more with Experts Exchange.


Get Answers

Join a Group Discussion

Collaborate

Monitor your Site

Explore solutions and more