close
Skip to main content
44,125 questions
Newest Active Bountied Unanswered

Question list filters

Filter by
Sorted by
Tagged with
Score of 0
1 answer
51 views

I installed Hive 3.1.3 with Hadoop 3.5.0 on Ubuntu 24.04 using OpenJDK 17. When I run hive, I get: java.lang.ClassCastException: jdk.internal.loader.ClassLoaders$AppClassLoader cannot be cast to ...
Score of -1
0 answers
51 views

I installed a different Java version along with Hadoop 3.4.0. Hadoop runs properly, but when I start Hive I get an error. To solve this, I tried deleting the Hadoop SLF4J JAR file, but then Hadoop ...
Tooling
0 votes
0 replies
46 views

I am not given access to the backup of some data required for work by my boss who holds the wrong belief that the backup and the production being backed share credentials. I have got people setting up ...
Advice
0 votes
5 replies
139 views

I currently have Java 24 installed on my system and I use it for my personal projects. However, for my college work with Hadoop, I need to run it on Java 17. How can I set up Hadoop to use Java 17 ...
Score of 0
0 answers
86 views

We have been using tdch approach for data loading from hadoop to teradata but now looking to load into a teradata view from Hadoop csv tables, I've tried batch insert using tdch but that is failing as ...
Score of 1
2 answers
128 views

I want to use a compression in bigdata processing, but there are two compression codecs. Anyone know the difference?
Score of 2
1 answer
74 views

I have an application using EKS in AWS that runs a spark session that can run multiple workloads. In each workload, I need to access data from S3 in another AWS account, for which I have STS ...
Score of 0
0 answers
352 views

I keep running into this issue when running PySpark. I was able to connect to my database and retrieve data, but whenever I try do operations like .show() or .count(), or when I try to save a Spark ...
Score of 0
1 answer
203 views

I am running Apache Hive 4.0.0 inside Docker on Ubuntu 22.04. The container starts, but HiveServer2 never binds to the port. When I try to connect with Beeline: sudo docker exec -it hive4 beeline -u ...
Score of 0
3 answers
419 views

I'm trying to read some file from S3 with PySpark 4.0.1 and the S3AFileSystem. The standard configuration using hadoop-aws 3.4.1 works, but it requires the AWS SDK Bundle. This single dependency is ...
Score of 0
0 answers
71 views

I'm having a Hive table emp1 with 100 partitions in Text format. I want Spark to read emp table based on partitions bases and write to EMP2 in parquet format. How to achieve 1) 10 Partition Read from ...
Score of 0
1 answer
91 views

Context: using distcp, I am trying to copy HDFS directory including files to GCP bucket. I am using hadoop distcp -Dhadoop.security.credential.provider.path=jceks://$JCEKS_FILE hdfs://nameservice1/...
Score of 0
0 answers
84 views

I’m trying to convert my PySpark script into an executable(.exe) file using PyInstaller. The script runs fine in Python, but after converting to an EXE and executing it, I get the following error: '...
Score of -1
1 answer
212 views

I have 67 snapshot in a single table but when i use CALL iceberg_catalog.system.expire_snapshots( table => 'iceberg_catalog.default.test_7', retain_last => 5 ); It doesn't delete any snapshot. ...
Score of 1
1 answer
49 views

When I build a hadoop cluster(version 3.3.6) by docker swarm. I have 3 machines, and 1 for namenode, all for datanode. After all starts, I checked everything, namenode is healthy, datanode is healthy, ...

15 30 50 per page
1
2 3 4 5
…
2942