Skip to content

java.util.zip.DataFormatException: incorrect data check #149

Description

@caleb87

I've been running this osmosis command to get changes for years, but today I tried and it's giving errors. It looks like the osc file finished, but failed a data check. The osc file looks ok. I tried on different files and had the same outcome every time.

Any ideas what this error is caused from?

sudo osmosis --read-pbf file="old.osm.pbf" --read-pbf file="new.osm.pbf" --derive-change --write-xml-change file="changes.osc"

and the output:

Jul 10, 2024 10:22:05 PM org.openstreetmap.osmosis.core.Osmosis run
INFO: Osmosis Version 0.47
Jul 10, 2024 10:22:05 PM org.openstreetmap.osmosis.core.Osmosis run
INFO: Preparing pipeline.
Jul 10, 2024 10:22:05 PM org.openstreetmap.osmosis.core.Osmosis run
INFO: Launching pipeline execution.
Jul 10, 2024 10:22:05 PM org.openstreetmap.osmosis.core.Osmosis run
INFO: Pipeline executing, waiting for completion.
java.util.zip.DataFormatException: incorrect data check
	at java.base/java.util.zip.Inflater.inflateBytesBytes(Native Method)
	at java.base/java.util.zip.Inflater.inflate(Inflater.java:385)
	at java.base/java.util.zip.Inflater.inflate(Inflater.java:471)
	at org.openstreetmap.osmosis.osmbinary.file.FileBlockPosition.parseData(FileBlockPosition.java:57)
	at org.openstreetmap.osmosis.osmbinary.file.FileBlockHead.readContents(FileBlockHead.java:95)
	at org.openstreetmap.osmosis.osmbinary.file.FileBlock.process(FileBlock.java:135)
	at org.openstreetmap.osmosis.osmbinary.file.BlockInputStream.process(BlockInputStream.java:34)
	at crosby.binary.osmosis.OsmosisReader.run(OsmosisReader.java:45)
	at java.base/java.lang.Thread.run(Thread.java:829)
Jul 10, 2024 10:34:14 PM org.openstreetmap.osmosis.core.pipeline.common.ActiveTaskManager waitForCompletion
SEVERE: Thread for task 1-read-pbf failed
java.lang.Error: java.util.zip.DataFormatException: incorrect data check
	at org.openstreetmap.osmosis.osmbinary.file.FileBlockPosition.parseData(FileBlockPosition.java:60)
	at org.openstreetmap.osmosis.osmbinary.file.FileBlockHead.readContents(FileBlockHead.java:95)
	at org.openstreetmap.osmosis.osmbinary.file.FileBlock.process(FileBlock.java:135)
	at org.openstreetmap.osmosis.osmbinary.file.BlockInputStream.process(BlockInputStream.java:34)
	at crosby.binary.osmosis.OsmosisReader.run(OsmosisReader.java:45)
	at java.base/java.lang.Thread.run(Thread.java:829)
Caused by: java.util.zip.DataFormatException: incorrect data check
	at java.base/java.util.zip.Inflater.inflateBytesBytes(Native Method)
	at java.base/java.util.zip.Inflater.inflate(Inflater.java:385)
	at java.base/java.util.zip.Inflater.inflate(Inflater.java:471)
	at org.openstreetmap.osmosis.osmbinary.file.FileBlockPosition.parseData(FileBlockPosition.java:57)
	... 5 more

Jul 10, 2024 10:34:14 PM org.openstreetmap.osmosis.core.pipeline.common.ActiveTaskManager waitForCompletion
SEVERE: Thread for task 2-read-pbf failed
org.openstreetmap.osmosis.core.OsmosisRuntimeException: An output error has occurred, aborting.
	at org.openstreetmap.osmosis.core.store.DataPostbox.checkForOutputErrors(DataPostbox.java:162)
	at org.openstreetmap.osmosis.core.store.DataPostbox.populateCentralQueue(DataPostbox.java:218)
	at org.openstreetmap.osmosis.core.store.DataPostbox.put(DataPostbox.java:305)
	at org.openstreetmap.osmosis.set.v0_6.impl.DataPostboxSink.process(DataPostboxSink.java:45)
	at crosby.binary.osmosis.OsmosisBinaryParser.parseWays(OsmosisBinaryParser.java:183)
	at org.openstreetmap.osmosis.osmbinary.BinaryParser.parse(BinaryParser.java:121)
	at org.openstreetmap.osmosis.osmbinary.BinaryParser.handleBlock(BinaryParser.java:68)
	at org.openstreetmap.osmosis.osmbinary.file.FileBlock.process(FileBlock.java:135)
	at org.openstreetmap.osmosis.osmbinary.file.BlockInputStream.process(BlockInputStream.java:34)
	at crosby.binary.osmosis.OsmosisReader.run(OsmosisReader.java:45)
	at java.base/java.lang.Thread.run(Thread.java:829)

Jul 10, 2024 10:34:14 PM org.openstreetmap.osmosis.core.pipeline.common.ActiveTaskManager waitForCompletion
SEVERE: Thread for task 3-derive-change failed
org.openstreetmap.osmosis.core.OsmosisRuntimeException: An input error has occurred, aborting.
	at org.openstreetmap.osmosis.core.store.DataPostbox.checkForInputErrors(DataPostbox.java:174)
	at org.openstreetmap.osmosis.core.store.DataPostbox.consumeCentralQueue(DataPostbox.java:244)
	at org.openstreetmap.osmosis.core.store.DataPostbox.hasNext(DataPostbox.java:441)
	at org.openstreetmap.osmosis.set.v0_6.ChangeDeriver.run(ChangeDeriver.java:108)
	at java.base/java.lang.Thread.run(Thread.java:829)

Jul 10, 2024 10:34:14 PM org.openstreetmap.osmosis.core.Osmosis main
SEVERE: Execution aborted.
org.openstreetmap.osmosis.core.OsmosisRuntimeException: One or more tasks failed.
	at org.openstreetmap.osmosis.core.pipeline.common.Pipeline.waitForCompletion(Pipeline.java:146)
	at org.openstreetmap.osmosis.core.Osmosis.run(Osmosis.java:92)
	at org.openstreetmap.osmosis.core.Osmosis.main(Osmosis.java:37)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at org.codehaus.plexus.classworlds.launcher.Launcher.launchStandard(Launcher.java:321)
	at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:234)
	at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:406)
	at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:347)
	at org.codehaus.classworlds.Launcher.main(Launcher.java:47)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions