Marble/HistoricalMaps

From KDE TechBase

Historical Maps for Marble

So you want to add a historical map to Marble. This is great since we want to see lots of historical maps in Marble where the user can browse through space and time. There are lots of very early world maps that are under the public domain. You'll find several on Wikipedia. A pretty comprehensive list of all early world maps is available at:

[| List of World Maps]

[| Map List translated via Google Translate]

You can choose a map from that list (or a different place. The map you choose should

  • cover the whole world as it was known at that time (or at least much of it)
  • have a resolution that is high<(i> enough (ideally starting around 2000x1500 pixel and above).
  • have a proper license (Public Domain or CC by SA 3.0 would be alright)
  • feature some interesting details that make it stand out against others (that is usually the case).
  • be readable (avoid blurry ones).
  • be provided in a projection that is easy to reproject

Reprojection is necessary to allow Marble to make use of the map. Generally early world maps are available in the following categories.

  • Stereographic Projection (the two hemispheres are displayed as two circles/discs) - This one is pretty straight-forward to reproject (but takes some time nevertheless). [[1]]
  • Mercator Projection - These can be used quite easy "as is" and don't require reprojection. [[2]]
  • Other projections - These could be either maps which have no real projection or maps which have a more fancy projection. These maps are usually not very straight-forward to reproject.

If you haven't worked on historical maps, we suggest to start with the stereographically projected maps ("A"):

A. Reprojecting maps provided in Stereographic Projection

Always make sure to back up the results of each step into a separate image file! Always use lossless compression file formats for all operations! This will allow you to later on tweak your map further if required.

Step 1: Download

Download the raw file. As an example we start off with this nice map from Jodocus Hondius made in 1595:

[[ http://upload.wikimedia.org/wikipedia/commons/b/b5/1595_Vera_Totius_Hondius.jpg%7Chttp://upload.wikimedia.org/wikipedia/commons/b/b5/1595_Vera_Totius_Hondius.jpg]]

This map has a resolution of 3.281 × 2.343 which gives us good details.

We create a directory "hondius1595" and save our raw file "1595_Vera_Totius_Hondius.jpg" there.

Step 2: Cropping the hemispheres

We need to crop the two hemispheres and we need to save them in two different files. You can use Krita, Gimp or Photoshop for that. Make use of the "Crop" tool:

You should crop each circle so that the circular outline of the map is preserved:

Some of the maps have a black-white "dashed" degree scale that serves as a circular outline. It's important that the dashed scale gets included as well! This needs to be the case on the "inner" side as well as on the "outer" side. Here is a different example which has the inner side of the scale bar discontinued but we still crop as if it was still there:

Once you finished cropping you need to scale the hemisphere so that height and width have the same amount of pixels. Otherwise the reprojection tool won't work. In our example after cropping the resulting image had 1605x1625 pixels. You will have a very different value of course. For scaling it's important to use a high quality scaling algorithm: choose Cubic or Lanczos3. After scaling the image up the size is 1625x1625 in our example (which again will be different for your images).

When scaling the second hemisphere we make sure that it has the same size as the first hemisphere.

Save the two hemispheres in two different files. Make sure that you choose "PPM" as a file format!

Now we should have the two PPM files of the two hemispheres in our directory (in our example it's "1595_Vera_Totius_Hondius_east.ppm" and "1595_Vera_Totius_Hondius_west.ppm").

Step 3: Reproject the hemisphere files

If you haven't done so, please download the stereographics conversion tool from here:

File:Stereographic2platecarree lgpl.tar.gz

Create a new directory (e.g. "stereo") and move the tar-ball inside. Inside this directory untar the tarball like this:

tar xvzf Stereographic2platecarree_lgpl.tar.gz

and then start compilation in the konsole inside the directory using:

make

For convenience you can copy the resulting stereographic2platecarree executable into the directory that contains your map files (in our example that is the "hondius" directory.

Once you've done that you can invoke the executable like this:

./stereographic2platecarree -i 1595_Vera_Totius_Hondius_east.ppm -o 1595_Vera_Totius_Hondius_east_reprojected.ppm

and the tool will the start its work:

Importing PPM '1595_Vera_Totius_Hondius_east.ppm'..
Import done.
Converting projection..
Conversion done.
Exporting PPM '1595_Vera_Totius_Hondius_east_reprojected.ppm'..
Export done.

Once you've done the same for the western hemisphere you should have two files which should look about like this:

You are now ready for the next step.

Step 4: Concatenate the two hemispheres

We have two files in equirectangular projection now. One for each hemisphere. We want to concatenate them so that we get a full world map. We can do this by by increasing the canvas width (in Gimp: Image->Canvas Size): we want a canvas size where the width is twice the height. If your canvas height is e.g. 1625 pixels then the width should become 3250 pixels. The original image should align to the left side of the resulting canvas. Now you can copy the full eastern hemisphere and paste it into the enlarged canvas (you might need to create a new layer for that). Be very careful that it properly aligns to the right. Also make sure that the equator, the upper and the lower border align in a pixel perfect way! And make sure that there is no pixel gap in the center or on the right. Better double-check before you proceed!

If the alignment doesn't work out then you might want to carefully scale, move and crop in order to get an acceptible solution. But usually it should do without. Also if the eastern and western hemisphere vary in terms of saturation or color balance you might want to adjust one of the hemispheres accordingly.

As a result you should have an image like this:

Now flatten both layers (in Gimp: "Image->Flatten Image"). Save the resulting file, make sure you use a lossless format like ppm or png!.

Step5: Normalize the longitude

Now we need to adjust the longitude of our worldmap so that it somewhat matches that of modern maps:

Download

Then resize the map so that the size matches the size of your reprojected world map. Once that is done open your reprojected world map and copy it. Then you go back to the scaled bluemarble.jpg and insert it there as a new layer on top of the satellite image (in Gimp: Edit->Paste as New Layer).

Now open the Layers Dialog (Gimp: Windows->Dockable Dialogs) and adjust the Opacity of the upper layer so that it has 70% Opacity and becomes translucent:

Now you need to move the upper layer so that both maps align at 0° longitude. The definition of the prime meridian has changed throughout the centuries. Therefore we take approximately London (Greenwich) as a reference point. You might also want to take the coastline of Middle Europe and middle Africa into account. The result will look about like this:

Now set the opacity of the top layer back to 100%. You can see that the right part of the map has moved out of the canvas area. We need to cut this part off: You can increase the width of the canvas a bit to get hold of the overhanging part. Then cut and paste the overhanging part into a new layer on the left. The result should look like this:

Delete the layer which still contains the bluemarble.jpg. Flatten the image so that there is just a single layer left. Double check that there are no pixel gaps between the pasted areas and no pixel gaps at the image borders. Save the resulting image into a new file using a lossless file format.

Now it's time for a break: A big amount of work is still ahead. After the break we are ready for the next step.

Step 6: Retouch the resulting map

Now comes the hard part which requires photo retouching skills. This might take a few hours. A graphics tablet might be handy - but it's not necessary: We need to retouch the map. While retouching it's of course important that we still retouch the map in a way that it doesn't make radical changes. The original spirit of the map should still be preserved.

So here are things that you should look at:

a.) You've probably noticed that at the top and bottom part of the map the longitude lines become thicker towards the poles. We need to fix that in creative ways: Usually this can be done by copying the contents of one or several grid-rectangles into the "smeared" pole area. Afterwards you can use the Clone tool to tweak the appearance further. By putting the copied areas into different layers you can "erase" back some text that you might have "overpainted". Make sure that you don't accidently leave text erased. Take your time. This retouching part requires patience and exercise. And it's essential.

b.) After our copy/paste operations the grid lines of the original map might not line up completely in all places. Use the Clone tool to adjust the lines so that they come together.

c.) You might also want to repair some text labels, coordinate scales, stains or other severe bugs. But be careful no to overdo it.

d.) At the end you might want to adjust the color levels of the map: Change it so that it goes well with the colors used in the other Marble maps (saturation, color range, etc.). But again: don't overdo it.

Once you are done with retouching save the resulting map into a new file. During the retouch phase it's advisable to create "backup files" often so that you can easily return to an earlier state.

Step7: Create a dgml file

Step8: Create a preview icon

Step9: Create the legend entries

Step10: Package the historic map

If you want to learn more about early world maps then have a look [[3]]

(please add further ones to the list as you find them) and elsewhere on the internet:

-- Magnus has completed this one already
-- Magnus has completed this one already

Licensing

If you find new maps it's always important to check the license. Although ancient maps should usually be under the public domain there are several people who claim copyright on the data due to the image manipulation work they have done as a part of post-processing the scan. No matter whether this is legitimate or not we should respect those claims and look for data that was intended to be published under the public domain (or another free license) and use that.

It's important to note that people like to distribute imagery "free for non-commercial usage". Unfortunately we are not able to use and distribute this data as this would e.g. prohibit most Linux Distributors from distributing our software. So do not use data that is "free for non-commercial use"! It's not suitable for our purposes. If you think that there is a chance that the author might agree to change the license to a less restrictive one then it might be worth to contact him. However pretty often the "non-commercial" wording is provided intentionally this way to allow for a business case of the author.

Preparing Historical Maps for use in Marble

Maps for Marble need to get provided in plate carrée projection (also referred to as "Equirectangular projection"):

There are morphing tools that will let you morph ancient maps into the desired projection. It doesn't require too many skills. Just some patience and love to detail.


You can use xmorph/gtkmorph to morph the images. It is a old piece of software, and is not actively maintained anymore. However it is mature enough for what we need. It likely is in your distribution's repository, if not you can get it on sourceforge.

To load the image you want to choose into gtkmorph, click on the "Load image" button on the "input image" window. You can adjust where the mesh's position and the image size, it will be easier if you roughly align the mesh with map before you start. But before you click "Apply", you must change the resolution on the resulting image, to do this you need to change the "width" and "height" on the bottom of the "resulting image" window.

Cropped. Bad

Be careful as gtkmorph has a tendency to crop the images, even if the resulting image is the same resolution as the original!!

Full circle. Good


By default you there are only a few mesh lines, to get more right-click on the field and choose "add horizontal line" and "add vertical line" - there appears to be a hotkey, but that don't seem to work. You can also set the minimum amount of lines to ~50 by editing the libmorph/morph.c line 48 & 49, but that may be going too .

Once you've got it all setup you are gonna start on the more repetitive task, you're gonna need to place the yellow dots so that the grid aligns with the grid on the map.

If you align every second line on the mesh to every line on the map, that will give you some wiggle room if the line between two dots don't really follow the line on the map.

Once you have set all the yellow dots you simply click the 'do warp' button and about a half a minute later you'll hopefully have something like this: Then save the image by clicking on the 'save image' button, the result should be a square map that can be used in Marble. Save the mesh, and export the image, .PPM and .PNG should be a good choice of format.