Route Art How To Prepare Lidar Dem Data?

Discussion in 'PC Editor Discussion' started by protonmw, Sep 19, 2023.

  1. SprayStealer

    SprayStealer New Member

    Joined:
    Sep 26, 2023
    Messages:
    3
    Likes Received:
    2
    • Like Like x 2
  2. DTG Lukas

    DTG Lukas Developer Staff Member

    Joined:
    Dec 18, 2017
    Messages:
    69
    Likes Received:
    437
    Delete everything except the .asc
    Make sure the files fine, if you have 0kb or very small .asc files in there, those might crash it. Havent checked this against, reality, it might not survive bad data.

    So try it with some files that you know are full of data first

    They will look something like this
    (yes I used 3000x3000 here, that works too.)
    upload_2023-9-28_0-52-38.png
     
    • Helpful Helpful x 3
  3. VictoryWorks

    VictoryWorks Well-Known Member

    Joined:
    Sep 22, 2017
    Messages:
    264
    Likes Received:
    1,380
    • Like Like x 1
    • Helpful Helpful x 1
  4. bremen

    bremen Active Member

    Joined:
    Aug 24, 2023
    Messages:
    128
    Likes Received:
    105
    I'll try this evening. I don't have the dataset with me.
     
  5. VictoryWorks

    VictoryWorks Well-Known Member

    Joined:
    Sep 22, 2017
    Messages:
    264
    Likes Received:
    1,380
    The LIDAR seems ok, and I can now import and apply it without a crash.
    However.. when I generate the initial landscape from the hgt files (I'm using 2, N50W001 and N50W002) it looks ok but I only get 1 LandscapeStreamingProxy generated - whereas on the Editor stream it created a LOT more. When I apply my LIDAR to that single LSP I get a kind of weird right angle L shape of landscape nowhere near where it should be and with no discernible features.
     
  6. Lulon

    Lulon Active Member

    Joined:
    Dec 3, 2017
    Messages:
    111
    Likes Received:
    120
    I got the LIDAR imported, too, but it flattens all the SRTM terrain around it. I also have these weird steep edges along the borders of the tiles. I don't know if thats normal. At least I would be able to fix the edges using the landscape tool.
    upload_2023-9-28_13-47-55.png
    This is what my .asc header looks like:
    upload_2023-9-28_13-50-52.png
    Not as clean as the one from Lukas and with a lot of zero padding.
    I don't really know how to achieve the same result as Lukas with QGIS.

    What I did was import multiple tiles in .xyz format in UTM32N CRS, merge them, reproject that using GDAL Warp to EPSG:3857 - WGS 84 / Pseudo-Mercator, set output res (-tr option) to 1.0, tiled that and convertd to .asc. After tiling, I deleted every tile with almost only zeros
     

    Attached Files:

    Last edited: Sep 28, 2023
    • Like Like x 1
  7. KrisKol

    KrisKol Active Member

    Joined:
    Apr 2, 2023
    Messages:
    179
    Likes Received:
    104
    It seems like a very convoluted procsess to put all the LiDAR into one big tile first, and then re-project it. I have never seen that being done anywhere before.

    I thought it would be enough to just reproject any already existing LiDAR data into EPSG 3857, WGS 84 / Pseudo-Mercator, then save in the .asc format, to a Terrain Data folder in your route folder and then it would just be fine. But obviously not.
     
    Last edited: Sep 28, 2023
  8. Lulon

    Lulon Active Member

    Joined:
    Dec 3, 2017
    Messages:
    111
    Likes Received:
    120
    I acutally did import single reprojected LIDAR tiles and it worked. I don't know if there is a specific reason to merge it all together and then tile other than its faster? But I'd rather wait until someone posts an "official" approach, because it's really hard to figure it out by trial and error and I don't want to do it all over again
     
    • Like Like x 1
  9. KrisKol

    KrisKol Active Member

    Joined:
    Apr 2, 2023
    Messages:
    179
    Likes Received:
    104
    I saw that you had done that, with some success. :)

    I also have to let it go for now, because I have never seen anyone in GIS or Civil Engineering even do that before.

    None of my original is ruined or anything, but I dont want to fiddle around in the editor anymore tonight with something that I do know about, but being done in a seemingly strange way that I have never seen before. He is probably trying to save space or RAM or something. Thats about the only reason I think he might have done it in that way.

    What I have is just 1Km x 1Km squares of LiDAR, in raw Laz and some GeoTIFF, with a defined projection for its location as it came.

    I will just wait for offical tutorials and explainations as they come. If ever.
     
    Last edited: Sep 28, 2023
  10. DonnyDave

    DonnyDave Active Member

    Joined:
    Jun 29, 2020
    Messages:
    222
    Likes Received:
    106
    downloaded the hgt file of the area I wanted from 30-Meter SRTM Elevation Data Downloader (dwtkns.com) unfortunately I couldn't zoom further to capture the Conisbrough to Mexbourgh are I'm wanting to get but went ahead and downloaded the file that covered these areas and its a lot of data for the area covered. Now in UE 5.3 to import landscape area in either .raw or .png formats you went into landscaping mode and browsed to the file you wanted to import and it would import it but with .hgt files I get file type not recognised. so gonna look online for a .hgt to .png file converter and see how it goes from there
     
  11. KrisKol

    KrisKol Active Member

    Joined:
    Apr 2, 2023
    Messages:
    179
    Likes Received:
    104
    I dont think TSW 4 Route Editor is going to be very happy with that format.
     
  12. DonnyDave

    DonnyDave Active Member

    Joined:
    Jun 29, 2020
    Messages:
    222
    Likes Received:
    106
    nope didn't work so back tot he drawing board
     
  13. OldVern

    OldVern Well-Known Member

    Joined:
    Nov 2, 2020
    Messages:
    18,782
    Likes Received:
    37,961
    As an aside, it looks like LiDAR coverage for the UK is not complete. Tried to find something along the course of the old Campbeltown & Machrahanish and returned a blank.
     
  14. DonnyDave

    DonnyDave Active Member

    Joined:
    Jun 29, 2020
    Messages:
    222
    Likes Received:
    106
    you can get uk lidar data from here Defra Survey Data Download but it downloads it in a .tif format and not .asc which will was showing in one of the streams video they did with matt
     
    • Like Like x 1
  15. DonnyDave

    DonnyDave Active Member

    Joined:
    Jun 29, 2020
    Messages:
    222
    Likes Received:
    106
    Decided to scrap importing landscape data till more information becomes available and create my own landscape, every time i select the alpha brush my editor crashes so select the send data and restart only to have my landscape removed :( making some progress someprogress.png
     
    Last edited: Sep 28, 2023
  16. protonmw

    protonmw Active Member

    Joined:
    Mar 18, 2022
    Messages:
    180
    Likes Received:
    144
    DTG Lukas How is this done? With only having lidar data I´m missing the "create landscapes"-button shown in live stream @ 19:12
     
    • Like Like x 2
  17. DonnyDave

    DonnyDave Active Member

    Joined:
    Jun 29, 2020
    Messages:
    222
    Likes Received:
    106
    when my brush selection stops crashing i can work on my terrain properly
     

    Attached Files:

  18. OlaHaldor

    OlaHaldor Member

    Joined:
    Apr 10, 2019
    Messages:
    26
    Likes Received:
    35
    Thank you! I saw the arrow but missed the purpose of it. So I was on the right track after all, just did some tiles manually. :)
     
  19. OlaHaldor

    OlaHaldor Member

    Joined:
    Apr 10, 2019
    Messages:
    26
    Likes Received:
    35
    I am confused and lost.. I have successfully created 114 tiles in *.asc file format, imported successfully in the editor, and when I go to create landscape, it only creates one single tile. What the.. ?


    EDIT
    I found that moving the camera around, selecting a generated tile and click the Create Landscapes button again, then move camera, create landscape.. over and over, I would eventually get the landscape tiles filled in. But it's an extremely tedious process.

    Is this seriously the only way to go?

    I'm also having the issue that applying LIDAr flattens the landscape generated by the HGT. :|


    Edit again:
    I was told to try adjusting the "Tiles around current" value, and so I did. Now I'm generating 400 tiles in one go. Exciting!
     
    Last edited: Sep 28, 2023
    • Like Like x 2
  20. OlaHaldor

    OlaHaldor Member

    Joined:
    Apr 10, 2019
    Messages:
    26
    Likes Received:
    35
    Okay so I've got a good chunk of a line created using the low resolution HGT files.
    Selecting a few tiles and apply LIDAR, results in this.
    upload_2023-9-29_0-13-46.png

    I'm gutted. I don't understand why. The tiles have data. I'm suspecting the tiles somehow have got the wrong coordinates. All I can say is I've followed the information thus far; apply/convert/transform to pseudo-mercator.
    Screenshot from Houdini to compare. (not exactly the same area, but you get the idea.. there's good data here)
    upload_2023-9-29_0-18-9.png



    While I wait for more information about all this, at least you can get a sense of the quality of the data I got.
    upload_2023-9-29_0-46-53.png
     
    Last edited: Sep 28, 2023
    • Like Like x 3
  21. DonnyDave

    DonnyDave Active Member

    Joined:
    Jun 29, 2020
    Messages:
    222
    Likes Received:
    106
    Followed a YouTube vid created 2 year ago and got this result after some scale tweaking but cannot alter the terrain and if i close the editr my terrain hasn't saved and theres no files been added to my folder that I can click on to open the landscape
     

    Attached Files:

    Last edited: Sep 29, 2023
  22. OlaHaldor

    OlaHaldor Member

    Joined:
    Apr 10, 2019
    Messages:
    26
    Likes Received:
    35
    Importing a heightmap using the default Unreal tools is no problem.
    I haven't watched the video, so perhaps you can tell me. Does that place the tile in the correct real world coordinate? So if you were to import Open streetmap data (or similar) for road networks, building placement and so on, will it match?

    If no; the tile is placed at 0,0,0 which renders it useless if you plan to rely on other data and services for assets placed in the real world location.
     
    • Like Like x 1

Share This Page