oblique aerial photographs - an “old-new” data source · was based on horizontal and oblique...

19
The Photogrammetric Journal of Finland, Vol. 24, No. 2, 2015 Received 30.06.2015, Accepted 21.10.2015 Doi:10.17690/015242.1 1 OBLIQUE AERIAL PHOTOGRAPHS - AN “OLD-NEW” DATA SOURCE Kimmo Nurminen 1 1 Finnish Geospatial Research Institute, National Land Survey of Finland [email protected] ABSTRACT New imaging platforms, progress in digital cameras, the use of GNSS/IMU technology either in direct sensor orientation or in integrated sensor orientation, new thinking with regard to control information in georeferencing, and co-operation between two disciplines – photogrammetry and computer vision – have brought the possibility of using oblique aerial photographs as a data source into the limelight. This article sheds light on the history of oblique aerial photographs, gives information about related practical experiences, and envisions the possible near future related to this new-found photogrammetric data product. An important new finding of this study is the use of time-series of oblique photographs for enabling image orientation in structure-from- motion software. 1. INTRODUCTION The art of photogrammetry started in a terrestrial form, and much of the early development was based on horizontal and oblique photographs (Slama, 1980). Although man reached the sky in hot-air balloons already in the late 18 th century, the start of aerial photogrammetry can be dated in 1850s. In 1852 Laussedat produced a map from photographs and experimented with aerial photography in 1858 (Lyon, 1959). Tournachon became the first aerial photographer (Slama, 1980) and the first aerial oblique photograph was taken by Black in 1860 (Rupnik et al., 2014). Image quality has been pursued right from the beginning – Tournachon was awarded a patent for keeping the camera vertical and stable (Slama, 1980). C. B. Adams, a US army officer, patented a method of making maps from vertical photographs; the method is nowadays known as the radial line method of control extension (Lyon, 1959). Another US army officer, S. Reber, introduced an extension of Adams´s method in 1896, which was designed for oblique photographs. Oblique imaging geometry was utilised by some cameras in the early 20 th century, such as Scheimpflug´s 8-lens camera, Aschenbrenner´s 9-lens camera and Reading´s 9-lens camera (Slama, 1980). Perhaps the best known utilisation of oblique aerial photography in mapping is the Canadian grid method (Wolf, 1974). In military use, oblique imagery has been one of the key imaging tools from its inception. The definition of an oblique image is that it has been intentionally taken tilted at least 10 gon from the plumb line (Thompson, 1966). In addition, oblique images can be classified as high obliques or low obliques, in respect of whether the horizon is visible in the image or not, respectively (Slama, 1980). The majority of civil photogrammetric missions since the 1940s have been conducted with vertical aerial imagery. The advantages of vertical images are their more meaningful conversion to orthographic projection, more uniform occlusion throughout the image, more constant image scale, and perhaps the easier interpretation of structural

Upload: others

Post on 19-May-2020

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: OBLIQUE AERIAL PHOTOGRAPHS - AN “OLD-NEW” DATA SOURCE · was based on horizontal and oblique photographs (Slama, 1980). Although man reached the sky in hot-air balloons already

The Photogrammetric Journal of Finland, Vol. 24, No. 2, 2015 Received 30.06.2015, Accepted 21.10.2015 Doi:10.17690/015242.1

1

OBLIQUE AERIAL PHOTOGRAPHS - AN “OLD-NEW” DATA SOURCE

Kimmo Nurminen1

1Finnish Geospatial Research Institute, National Land Survey of Finland

[email protected]

ABSTRACT New imaging platforms, progress in digital cameras, the use of GNSS/IMU technology either in direct sensor orientation or in integrated sensor orientation, new thinking with regard to control information in georeferencing, and co-operation between two disciplines – photogrammetry and computer vision – have brought the possibility of using oblique aerial photographs as a data source into the limelight. This article sheds light on the history of oblique aerial photographs, gives information about related practical experiences, and envisions the possible near future related to this new-found photogrammetric data product. An important new finding of this study is the use of time-series of oblique photographs for enabling image orientation in structure-from-motion software. 1. INTRODUCTION The art of photogrammetry started in a terrestrial form, and much of the early development was based on horizontal and oblique photographs (Slama, 1980). Although man reached the sky in hot-air balloons already in the late 18th century, the start of aerial photogrammetry can be dated in 1850s. In 1852 Laussedat produced a map from photographs and experimented with aerial photography in 1858 (Lyon, 1959). Tournachon became the first aerial photographer (Slama, 1980) and the first aerial oblique photograph was taken by Black in 1860 (Rupnik et al., 2014). Image quality has been pursued right from the beginning – Tournachon was awarded a patent for keeping the camera vertical and stable (Slama, 1980). C. B. Adams, a US army officer, patented a method of making maps from vertical photographs; the method is nowadays known as the radial line method of control extension (Lyon, 1959). Another US army officer, S. Reber, introduced an extension of Adams´s method in 1896, which was designed for oblique photographs. Oblique imaging geometry was utilised by some cameras in the early 20th century, such as Scheimpflug´s 8-lens camera, Aschenbrenner´s 9-lens camera and Reading´s 9-lens camera (Slama, 1980). Perhaps the best known utilisation of oblique aerial photography in mapping is the Canadian grid method (Wolf, 1974). In military use, oblique imagery has been one of the key imaging tools from its inception. The definition of an oblique image is that it has been intentionally taken tilted at least 10 gon from the plumb line (Thompson, 1966). In addition, oblique images can be classified as high obliques or low obliques, in respect of whether the horizon is visible in the image or not, respectively (Slama, 1980). The majority of civil photogrammetric missions since the 1940s have been conducted with vertical aerial imagery. The advantages of vertical images are their more meaningful conversion to orthographic projection, more uniform occlusion throughout the image, more constant image scale, and perhaps the easier interpretation of structural

Page 2: OBLIQUE AERIAL PHOTOGRAPHS - AN “OLD-NEW” DATA SOURCE · was based on horizontal and oblique photographs (Slama, 1980). Although man reached the sky in hot-air balloons already

2

objects. Some pros for obliques are the easy object recognition for laymen, the visibility of vertical structures, and their larger footprint. In a convergent-low-oblique setup, in which oblique cameras image fore and aft, the base-height ratio can be increased to yield better height accuracy in stereoscopic data capture (Slama, 1980). The new appearance of oblique imagery happened temporally quite close to the transition to the digital camera era over a decade ago. There are many applications that can utilise the potential of oblique aerial photographs. Situations where side views of manmade structures are needed are particularly well suited to oblique photography. Xiao et al. (2012) presented a method for building detection and reconstruction based on airborne oblique photographs. Fritsch and Rothermel (2013) demonstrated dense image matching of nadir and oblique aerial photographs with two imaging systems, and gave recommendations for increased overlaps compared to the usual overlaps in aerial photogrammetry. Meixner and Leberl (2011) studied building floor and window classification accuracy as a function of tilt angle, the best values occurring in the range of 20° to 27°. In an earlier study, Meixner and Leberl (2010) concluded that the need for oblique imagery is not a necessity if high overlap vertical imagery is available. Other infrastructure-related oblique imagery studies have been published by Gruber and Walcher (2013), Nyaruhuma et al. (2012), Murtiyoso et al. (2014), Wang et al. (2008), Jurisch and Mountain (2008), and Prandi et al. (2008). Other applications that may benefit from oblique aerial imagery are land administration (Kisa et al., 2013; Lemmens et al., 2008), monitoring of dangerous sites (Marsella et al., 2014), coastal studies (Harwin and Lucieer, 2012), forestry (Lisein et al., 2013), emergency services (Artés, 2006) and structural damage assessment (Gerke and Kerle, 2011). With regard to applications of aerial oblique video images, Zhang et al. (2005) tested them for 3D city modelling, Rasika et al. (2006) and Kerle and Stekelenburg (2004) for disaster-induced damaged area classification, and Kumar et al. (2001) for aerial surveillance. Studies with historical images have been done by Nurminen et al. (2015), Vassilaki et al. (2012), Nocerino et al. (2012) and Redecker (2008) for example; in the last two of these studies oblique and split vertical imagery were mentioned. In this article, the state-of-art with regard to oblique aerial images is reviewed, important opportunities are highlighted, and test results presented. The most important finding of this article is the use of an oblique image time-series in a suburban area to enable image orientation with structure-from-motion software. In many organisations around the world there are dormant oblique image archives that contain valuable raw data for highly automatised modern point cloud creation software. Imagery captured for other reasons in the past may be well suited for point cloud creation. The greatest opportunities for oblique time-series are in urban areas, where buildings and structures may remain relatively unchanged for decades, thus giving correct image matches over time. 2. OBLIQUE IMAGING 2.1 Oblique imaging instruments Oblique camera systems can be categorised by geometric image formation, for example. The following list of systems is an adaptation from Petrie (2009, 2012), Meixner and Leberl (2010) and Rupnik et al. (2014). For some systems the end-product is a stitched virtual image of the separate camera heads. To enable as easy operability as possible with existing photogrammetric mission aircrafts, many oblique camera pods can be fitted to existing gyro-stabilised mounts.

Page 3: OBLIQUE AERIAL PHOTOGRAPHS - AN “OLD-NEW” DATA SOURCE · was based on horizontal and oblique photographs (Slama, 1980). Although man reached the sky in hot-air balloons already

3

Even though dedicated oblique camera systems are listed here, it should be remembered that single cameras starting from consumer-grade pocket-size cameras to professional-grade medium-format cameras are being used for oblique photography missions. A fan structure camera system consists of several obliquely looking cameras with their optical axes on nearly one vertical plane, looking in different directions in a cross-track manner. Examples of this type are IGI Dual DigiCAM Oblique, DLR 3k and Visual Intelligence iOne-IMS. With this kind of camera, visibility to the side can be extended. Another kind of camera system, known as a block structure camera, has several frame cameras combined in order to achieve larger ground coverage from a single imaging station. Examples of these are the Intergraph DMC (first generation), the Rolleimetric AIC x4, the IGI Quattro DigiCAM and the Urban Robotics PeARL six camera version. To be strict, some of these cameras cannot be categorised as real oblique cameras with regard to the optical axis deviation from the plumb line. However, some of them can be converted to become oblique cameras, e.g. the IGI Quattro DigiCAM to the IGI Quattro DigiCAM Oblique (Rupnik et al., 2014; IGI, 2015). In the third kind of camera system, one camera shoots vertically and four or more cameras obliquely. This kind of system is often called the “Maltese Cross” system, because of the resulting image footprints. Examples are the Pictometry camera system (Kalinski; Höhle, 2008; Wang et al., 2008), the Track´Air/Lead´Air Chimera 400 MP Midas, the Microsoft UltraCam Osprey (Gruber and Walcher, 2013) and the Leica RCD30 Oblique. If adequate overlaps are maintained, the advantage of this kind of system is that each object in the ground can be seen from above and four or more oblique directions. At its best, a “Maltese Cross” system is complemented by viewing software, which handles the imagery related to each ground location. In the fourth group the object to be imaged will be quickly scanned by area array sensors. This category includes stepping frame cameras, in which an area array rotates across the flying direction. One example of this is the VisionMap A3. The fifth group consists of pushbroom cameras. Their main operating principle is similar to Leica’s ADS series, but with greater oblique imaging angles. One example is the Wehrli/Geosystem 3-OC with 45° angle separation between the vertical scan and the backward and forward scans. The pushbroom imaging geometry differs from the usual frame sensor model. In a pushbroom image, each scanline has its own exterior orientation values. In practice this kind of sensor is dependent on auxiliary location and orientation sensors. Video cameras can be classified as a separate camera category. For years, even pocket-size cameras have been able to record Full HD video imagery. The trend is towards even better resolution and frame rates. One of the most potent video cameras today, with regards of resolution, is the Red.com Inc. Epic Dragon with 6K resolution. Rupnik and Jansa (2014) tested 30Hz dSLR video imagery in an industrial shape and motion reconstruction, concluding that the tested camera could be used as a measuring device and also finding that the lossy compression of the standard video format caused problems that could be handled with a Kalman Filter-based target motion model. If a video camera is under consideration for use in aerial photogrammetry, the operating principle of its shutter should be analysed. As a rule of thumb, focal plane shutters (FPS) should not be used with frame sensor imaging from a moving platform, because the resulted image does not conform to the general pinhole model. If an FPS is used, the dynamics of the imaging process should be evaluated with regard to the total

Page 4: OBLIQUE AERIAL PHOTOGRAPHS - AN “OLD-NEW” DATA SOURCE · was based on horizontal and oblique photographs (Slama, 1980). Although man reached the sky in hot-air balloons already

4

frame exposure time and the flying parameters and – if necessary – to consider the possibility of using a time-dependent image formation model. There are cameras that have both an FPS and a central shutter (depending on the lens), e.g. the Phase One iXA-R (Phase One) and the Leica S (Leica). One important feature of a modern photogrammetric camera is the forward motion compensation (FMC). The need for FMC can be evaluated when the intended flying speed, exposure time and imaging parameters are known. If FMC is needed in oblique image acquisition, and the imaging sensor is a frame sensor or a sideways-looking (i.e. left or right) pushbroom sensor, varying FMC should be used. Some of the oblique cameras in use nowadays do not include FMC or varying FMC. With regard to camera installations in vertical photography, performed traditionally from manned twin-engine aeroplanes, camera ports in the aircraft floor are normally used. For smaller aeroplanes or helicopters, pods can also be attached under the wing, fuselage or bow, or on a skid. Such products, some of them incorporating sensors, are available from vendors such as SkyImd (SkyImd), GGS (AeroShift), Hood Tech Vision (Hood Tech Vision), DART Aerospace (DART Aerospace), Airborne Scientific (Airborne Scientific), Pictorvision (Pictorvision) and Gyron Systems International (Gyron). 2.2 Flying platforms and georeferencing equipment The first, simplified categorisation of flying platforms can be made according to how the platform flies. There are aeroplanes, airships, gyrocopters and helicopters; in the following listing (Table 1), these are numbered from 1 to 4, respectively. There are also other ways of flying, such as hang gliding, paragliding, parachuting, gliding and kiting, which can be used in photogrammetry, but they are left out of this categorisation. In aeroplanes the lift originates from forward motion, causing compression under the wings. An airship, although quite rare in aerial photogrammetry, is a lighter-than-air platform that can move by its own power. A gyrocopter has an unpowered, auto-rotating rotor and a propeller for thrust. In a helicopter, lift and thrust are created by a rotor and the caused torque is compensated by counteracting force. For this study it is appropriate to use a subcategory according to payload in grams; here a three-step classification is used, namely A) under 500 grams, B) 500 – 20,000 grams, C) over 20,000 grams. The listed platforms are just examples of the myriad of total supply. Particular suitability for oblique imaging use has not been verified from the vendor. The payload of some of the presented examples is not user-replaceable. The choice of platform for a photogrammetric mission is also affected by the object area type, size and location, required accuracy, available funds, photogrammetric processing chain and the end-product. If manned platforms are an issue, the reasons for choosing a helicopter are the possibility of lower flying speeds and possibly an aviation authority permission to fly at lower heights than with a fixed wing aircraft; however, vibrations present with helicopters can mean that the pilot must fly at certain flying speeds instead of stationary hovering (Shortis and Ogleby, 1988). More detail on the subject has been provided by Colomina and Molina (2014), Eisenbeiß (2009), Honkavaara et al. (2009) and Kemper (2012). For added productivity and faster throughput times, modern aerial imaging systems are usually equipped with auxiliary georeferencing sensors. Georeferencing means tying the imagery to the chosen ground coordinate system. If the exterior orientation of the image is going to be solved by the measured and calibrated values of these georeferencing sensors, the approach is called direct georeferencing. There might be separate systems for the navigation of the platform. According to

Page 5: OBLIQUE AERIAL PHOTOGRAPHS - AN “OLD-NEW” DATA SOURCE · was based on horizontal and oblique photographs (Slama, 1980). Although man reached the sky in hot-air balloons already

5

Blázquez and Colomina (2012), the majority of (aerial) medium- to high-end mapping sensor systems have a geodetic grade GNSS (Global navigation satellite system) receiver and a tactical grade or better IMU (Inertial measurement unit). The GNSS/IMU system typically comprises a GNSS antenna in a place with good satellite visibility on the imaging aircraft, a GNSS receiver, an IMU, and a control and data recording unit (Beraldin et al., 2010). For decimetre-level accuracy, a differential GNSS measuring mode is needed; this can be implemented by a dedicated GNSS ground station or by using a national network of GNSS stations (Beraldin et al., 2010). Integration of GNSS and IMU is usually done so that the GNSS receiver is the main position sensor and the IMU the main orientation sensor (El-Sheimy, 2009). The GNSS gives in-motion calibration for the accelerometers and gyroscopes of the IMU (El-Sheimy, 2009). The IMU can be used for the detection and correction of cycle slips of the GNSS (El-Sheimy, 2009). Navigation information is gained by kinematic modelling of GNSS/IMU observations, usually by Kalman Filter (El-Sheimy, 2009). The exterior orientation of the camera must be traceable from the GNSS/IMU data; this includes the solution of temporal dependencies (Rehak et al., 2013; Grenzdörffer et al., 2008) and system calibration (Jacobsen, 2008; Madani, 2012; Tommaselli et al., 2013), and taking into account the related coordinate systems (Zhao et al., 2014; Bäumker and Heimes, 2001). It is of great importance to know the interior orientation of the camera if the direct georeferencing is used (Schenk, 1999).

Table 1: Examples of flying platforms categorised by operation principle and payload. Flying platform class

Examples

1A C-Astral Bramor C4EYE (C-Astral), senseFly eBee (senseFly) 1B Falcon Unmanned Falcon (Falcon Unmanned), FlyTech Solutions UAV FT-02

(FlyTech Solutions), MarcusUAV Zephyr2 UAV (MarcusUAV) 1C Beechcraft King Air C90GTx (Beechcraft), Cessna 206 Turbo Stationair (Cessna),

Diamond Airborne Sensing DA42 MPP GUARDIAN (Diamond Airborne Sensing), Piaggio Aerospace Avanti EVO (Piaggio Aerospace), Vulcanair P68 Observer (Vulcanair)

2B Anabatic MZ6000 Outdoor (Anabatic), FKC-1 (Wei, 2009), Galaxy Blimp 30’ Outdoor Blimp (Galaxy Blimps), Nimbus Dirigibles N-700 (Nimbus Dirigibles)

2C GEFA-FLUG AS 105 GD (GEFA-FLUG), Zeppelin NT (Zeppelin NT) 3C AutoGyro Cavalon (AutoGyro), DiNelly Aerosystems eXoGyro (DiNelly

Aerosystems), MMIST CQ10B (MMIST) 4A Airframe XM-6 Ti-QR (Aeronavics), Microdrones md4-200 (Microdrones) 4B Aibot X6 (Aibotix), Aeroscout Scout B1-100 UAV (Aeroscout), GOLIATH 8

(ArcTron 3D) 4C Airbus Helicopters H120 (Airbus Helicopters), Bell 206L4 (Bell Helicopter)

The orientation accuracy of an IMU is dependent mostly on the gyro drift rate (El-Sheimy, 2009). If the constant drift rate of the gyro is used for classification, four performance classes can be distinguished: strategic gyros (0.5 – 1.0 mdeg./h), navigation-grade gyros (2.0 – 15.0 mdeg./h), tactical gyros (100 – 10000 mdeg./h) and tow-accuracy gyros (100 – 10000 deg./h) (El-Sheimy, 2009). Technological development of IMUs is ongoing and, for example, there are location and orientation products using tactical gyros based on MEMS (microelectromechanical systems) technology (Novatel). For camera system development, many possibilities exist on the component market, such as Swift Navigation Piksi for GPS Real Time Kinematic receiver (Swift Navigation) and MEMS-based location and orientation devices (Applanix; iMAR Navigation; Xsens).

Page 6: OBLIQUE AERIAL PHOTOGRAPHS - AN “OLD-NEW” DATA SOURCE · was based on horizontal and oblique photographs (Slama, 1980). Although man reached the sky in hot-air balloons already

6

With oblique camera systems, which can be fitted to existing vertical camera mounts, the use of auxiliary georeferencing sensors is essentially similar to the vertical case. With handheld camera systems the use of GPS and IMU is also possible; Vallet (2007) described a Helimap System®, in which GPS, IMU, a 22 MP camera and a laser scanner are integrated in a handheld carbon-aluminium frame. Verhoeven et al. (2013) tested a Nikon DSLR camera-mounted GNSS/IMU for the purposes of archaeology. If low-cost and thus usually lower performance georeferencing equipment is used, the exterior orientation can often be improved in stereo-overlap situations by using traditional indirect photogrammetric methods. Positioning services in Finland are available from the Finnish Geospatial Research Institute (FGI) and GeoTrim (GeoTrim), for example. 3. PROCESSING OBLIQUE IMAGES Often the most important factor in accurate photogrammetric data capture is the camera calibration. In the calibration the principal distance, principal point offsets and lens distortions are determined (Remondino and Fraser, 2006; Kraus, 1993). There are different kinds of calibration types, starting from a laboratory calibration and ending up in an on-the-job calibration. In practice, the type of the camera to be calibrated and the aimed photogrammetric mission also affect the choice of calibration type. In the era of GNSS/IMU it has become popular to use photogrammetric test fields for system calibration (Tang, 2012; Cramer et al., 2010; Merchant et al., 2004; Grenzdörffer, 2008). Convergent imaging angles are needed in self-calibration to reduce the correlation between the interior and exterior orientation parameters (Brown, 1971; Walstra, 2006; Tommaselli et al., 2013). Thus, to-and-fro flying strips would be needed at minimum, when doing a calibration flight with fore- and aft-looking oblique camera systems. Once the camera calibration has been resolved, the actual image orientation with regard to the chosen coordinate system can begin. If there is no direct georeferencing solution available, a common procedure is to point known coordinates from the imagery. An option would be to stay in an arbitrary coordinate system. If ground control points (GCPs) are needed in the orientation, one solution might be to use one of the commercial GCP providers, such as CompassData (CompassData). Another solution could be to rely on existing data that has already been georeferenced, i.e. some imagery with a cognisable sensor model, and height information. In seeking automation, ground control points can be handled as image chips, whose ground locations are known (Schowengerdt, 1997). There is software available for chip management, e.g. from PCI Geomatics (PCI Geomatics) and Spacemetric (Spacemetric). With oblique photographs the location of GCPs should be chosen from flat, texturised, minimum occlusion areas, such as uncultivated fields, side of the road or manmade surfacing. In order to allow statistical evaluation of the GCP, it should be visible and pointed from several oblique photographs. However, the GCPs alone do not suffice when proceeding without the direct georeferencing solution into a bundle block adjustment. In the bundle block adjustment with the least squares method, the solution of nonlinear observation equations requires approximate exterior orientation values. It is more difficult to evaluate the values of unknown exterior orientation for an oblique photograph than it would be for a nadir photograph. The direct linear transformation (DLT) can be used for initial exterior orientation estimation for the frame camera sensor model. In computer vision it is quite common to use DLT, which is a direct conversion between image and ground coordinates. The great strength of DLT is that it does not need initial values for interior or exterior orientation values. In theory, the DLT solution needs six 3D GCPs, but in the author’s

Page 7: OBLIQUE AERIAL PHOTOGRAPHS - AN “OLD-NEW” DATA SOURCE · was based on horizontal and oblique photographs (Slama, 1980). Although man reached the sky in hot-air balloons already

7

own limited tests with oblique aerial images, the minimum amount of GCPs has been more than 20, if at least moderate result is required. The disadvantages of the DLT are slightly lower accuracy compared to a bundle block adjustment, and instability problems in the case of nearly coplanar GCPs (Mikhail et al., 2001; Karara, 1989). In typical cases the majority of the points in bundle block adjustment are not GCPs, but tie points. Automatic tie point matching in the case of vertical imagery has been traditionally most often accomplished by using correlation. In the correlation the assumption of non-affinity is not ideal with oblique photographs, due to their nature. There are other possibilities, too. Remondino (2006) lists affine region detectors, namely Harris-affine, Hessian-affine, Maximally Stable Extremal Region (MSER), Salient Regions, Edge-Based Region (EBR) and Intensity extrema-Based Region (IBR). When regions extracted with these detectors are given descriptor values, matching can be done by comparing the Mahalanobis or Euclidean distance between the descriptor elements (Remondino, 2006). Morel and Yu (2006) introduced Affine-SIFT (ASIFT), which is a fully affine invariant detector and descriptor. Geniviva et al. (2014) presented a technique for automatic georeferencing of low-altitude, high-resolution oblique imagery based on the use of ASIFT algorithm. To detect blunders in candidate matches, random sample consensus (RANSAC) (Fischler and Bolles, 1981) could be used, for example. After image orientation it is possible to measure 3D object coordinates by pointing corresponding image points in at least two images. It would be a considerable job to interactively seek all possible correspondences between overlapping images. Automatic surface modelling has been available for two decades and one of its recent developments is dense image matching. In dense matching, matches for each pixel in the reference image are sought from other images (Haala, 2013; Megyesi, 2009). Popular algorithms of dense matching are e.g. Semi-Global-Matching (SGM) (Hirschmüller, 2011) and DAISY (Tola et al., 2008). Sometimes it is necessary to align two height data sets with each other. Then algorithms like iterative closest point (ICP) can be used. There is software intended for oblique aerial images. Examples of these include Ofek Aerial Photography’s Ofek MultiVision (Ofek; Grenzdörffer et al., 2008), Idan Computers’ Oblivision (Idan), ICAROS IPS (ICAROS, Shragai et al., 2011) and Airbus Defence & Space Street Factory (Airbus). Fugro Geospatial offers oblique image and software solution PanoramiX (Fugro). Blom offers BlomOBLIQUE imagery to be utilised by BlomWEB or BlomDESKTOP viewers (Blom). Pictometry offers oblique imagery, Electronic Field Study software and web-based solutions (Pictometry). Sanborn also has a web-based solution called Oblique Analyst (Sanborn). Geospan offers GEOVISTA API for image access from mapping systems (Geospan). 4. DEMONSTRATIONS 4.1 VisualSFM and SURE with Nikon D2X oblique images Two pairs of slightly convergent oblique Nikon D2X image pairs with tilt angles of approximately 70.5° were oriented with eight and seven GCPs picked from the base map of the city of Helsinki. Flying heights of these images were between 140 and 180 metres above the average ground level (AGL). An orientation with a floating interior orientation was made with a computer vision software VisualSFM (Wu, 2013; Wu et al., 2011). VisualSFM uses SIFT features as a similarity measure.

Page 8: OBLIQUE AERIAL PHOTOGRAPHS - AN “OLD-NEW” DATA SOURCE · was based on horizontal and oblique photographs (Slama, 1980). Although man reached the sky in hot-air balloons already

8

The orientation data from the VisualSFM software was transferred to dense point cloud extraction software, SURE (Rothermel et al., 2012). SURE uses Semi-Global Matching (SGM) in the calculation. From the area an airborne laser scanning (ALS) point cloud was available and LAStools (LAStools) was used to extract the roof points from the data. A visualisation of the photogrammetric point clouds was created with software called CloudCompare (CloudCompare), picture 1. A cross-sectional comparison with the ALS data was performed with a FugroViewer software (FugroViewer), picture 2.

Picture 1: Two stereopair point clouds near Malminkartano railway station. ©

Kaupunkimittausosasto, Helsinki.

Picture 2: Cross-section of a building. Yellow points from oblique images, blue points from ALS.

© Kaupunkimittausosasto, Helsinki.

Page 9: OBLIQUE AERIAL PHOTOGRAPHS - AN “OLD-NEW” DATA SOURCE · was based on horizontal and oblique photographs (Slama, 1980). Although man reached the sky in hot-air balloons already

9

4.2 VisualSFM, Socet Set and SURE with Nikon D3X oblique images Structure-from-motion utilises high overlaps between images. In some cases the imagery of interest has not been collected with stereo compilation in mind or the imagery has been shot without adequate safety margins in stereo overlaps. The example images have been downloaded from the internet map service of the city of Vantaa (Vantaa) and their main purpose is for use in the general planning of Vantaa. In this study the imagery from 2011 from the Havukoski region was of interest, and the 12 images available from that year could not be oriented in one block with VisualSFM. The solution was to use all possible images from each year, namely 1996, 2001, 2004, 2007, 2011 and 2014, from the area. The images were photographed by Lentokuva Vallas (Vallas) and for the 2011 images the omega angle was about 47.9°, and flying height 1280 metres AGL. Some of the images in the internet map service were down-sampled versions and some were scanned film images. In total 80 images were put in VisualSFM and 52 of them could be handled in one block. Of those 52 images, 44 had GPS data inside the EXIF metadata, which was used to roughly orientate the block in the ECEF coordinate system, picture 3. An approximate coordinate transformation with the Coordinate Transformation Service (CoordTrans) of the Finnish Geospatial Research Institute (FGI) was used to proceed to the Finnish ETRS-TM35FIN/N2000 coordinate system. After this the data from 2011 was transferred to BAE Systems’ Socet Set software, in which automatic tie point calculation with blunder detection, observation of 27 manual GCPs referenced from the open data of the National Land Survey of Finland, and on-the-job-calibration were executed. The root of mean squared errors of the final bundle block adjustment were 0.89 pixels and 0.34 m (X), 0.65 m (Y), 0.54 m (Z) in the triangulation points.

Picture 3, visualisation of image orientation in VisualSFM software. © Copyright Vantaan

kaupungin mittausosasto 2015, Nro 05/2015. The coordinates of the projection centres were brought back to VisualSFM, in which the 52-image block was re-oriented with these 12 image-capturing locations with 4.52 m root of mean squared error in the transformation. The image orientations of the images from 2011 were transferred to SURE, where point clouds were calculated for visualisation purposes, picture 4. With the presented procedure it might be possible to get colour and structural information of the facades for the purpose of virtual city construction, for example. If simultaneous data is required, possible low stereo overlaps of the photographic missions can restrict comprehensive point cloud coverage; even in that case, any city models that already exist could be used in monoplotting

Page 10: OBLIQUE AERIAL PHOTOGRAPHS - AN “OLD-NEW” DATA SOURCE · was based on horizontal and oblique photographs (Slama, 1980). Although man reached the sky in hot-air balloons already

10

mode by a single image ray intersection with the city model surface. To improve the VisualSFM software it would be useful to incorporate more complex lens distortion parameters. For high-accuracy work it could also be useful to take the earth curvature and atmospheric refraction into account, especially noting the oblique imaging geometry. Furthermore, it would be very useful in the VisualSFM software if the user could nominate different cameras for different groups of images. If further steps of the created point cloud were considered, some kind of point classification based on the city base map could be developed. Further studies are needed to bring greater clarity to the success of using time-series in this test. Although there are large sideviews of buildings that are rather unchanged, the vegetation has grown during the years. One possibility may be that the downsampling of some of the imagery collection years actually helped in the solution. It is more obvious though that the automatic rejection of bad points is working as planned in the VisualSFM software.

Picture 4, point cloud of the Havukoski region, Vantaa. Original use of the oblique imagery is the

general planning of Vantaa, © Copyright Vantaan kaupungin mittausosasto 2015, Nro 05/2015.

Additional georeferencing data National Land Survey of Finland, NLS orthophotos 06/2015 and Elevation model 10 m 06/2015.

5. CONCLUSIONS In the past, oblique aerial images were mainly used for presentation or interpretation purposes. In the last 15 years these images have been commonly and increasingly used for measuring purposes. There are different opportunities for their metrical use, ranging from smart single-image-based measuring techniques to utilising stereo-overlaps and different viewpoints to the object. Computer vision-originated procedures have had a great impact on the ease of use of these images. To boost the possibilities of oblique images even further, systematic stereo-overlapping image sets should be collected. This study shows that in structure-from-motion software, it is possible to enhance the oblique image orientation by using oblique image time-series. There is one existing technique that could revolutionise the scene in the near future, namely high-resolution oblique video imaging in a resolution range of between 4K and 8K. More studies are

Page 11: OBLIQUE AERIAL PHOTOGRAPHS - AN “OLD-NEW” DATA SOURCE · was based on horizontal and oblique photographs (Slama, 1980). Although man reached the sky in hot-air balloons already

11

needed in terms of intersection accuracy in order to fulfil possible uses in mapping. Applications requiring sideview visibility for objects can benefit the most from oblique images – these applications include city mapping and planning, virtual city reconstruction, structure inspections, emergency services, and military, forestry and coastal research. ACKNOWLEDGEMENTS This work was partly carried out in the MMEA research programme, coordinated by Cleen Ltd., with funding from the Finnish Funding Agency for Technology and Innovation, Tekes. The author wishes to also thank the cities of Helsinki and Vantaa for the test data. REFERENCES Aeroscout, http://www.aeroscout.ch/downloads/Aeroscout_Scout_B1-100_Brochure.pdf, accessed 16.6.2015. Aeronavics, http://aeronavics.com/products/guide/, accessed 19.6.2015. AeroShift, http://www.aeroshift.de/html/aeroshift.html, accessed 24.6.2015. Aibotix, https://www.aibotix.com/en/camera-suspension.html, accessed 19.6.2015. Airborne Scientific, http://www.airbornescientific.com/node/1, accessed 24.6.2015. Airbus, http://www.geo-airbusds.com/streetfactory/, accessed 30.6.2015. Airbus Helicopters, http://www.airbushelicopters.com/website/en/ref/H120_26.html, accessed 20.6.2015. Anabatic, http://www.anabatic.aero/twin_specifications.php, accessed 19.6.2015. Applanix, http://www.applanix.com/products/airborne/apx15uav.html, accessed 28.9.2015. ArcTron 3D, http://www.arctron.de/en/products/copter/, accessed 19.6.2015. Artés, F., 2006, Georeferenced oblique aerial imagery, Pictometry – intelligent visual technology, GEO Informatics, March 2006, pp. 20 – 23. AutoGyro, http://www.auto-gyro.com/en/Cavalon/, accessed 20.6.2015. Beechcraft, https://www.beechcraft.com/special_missions/assets/documents/Beech_US_Aerial_Survey_Litho.pdf, accessed 17.6.2015. Bell Helicopter, http://www.bellhelicopter.com/en_US/Commercial/Bell206L4/1291148332333.html#/?tab=highlights-tab, accessed 20.6.2015.

Page 12: OBLIQUE AERIAL PHOTOGRAPHS - AN “OLD-NEW” DATA SOURCE · was based on horizontal and oblique photographs (Slama, 1980). Although man reached the sky in hot-air balloons already

12

Beraldin, J.-A., Blais, F., Lohr, U., 2010. Laser scanning technology, in G. Vosselman, H.-G. Maas, eds., Airborne and terrestrial laser scanning, Whittles Publishing, pp. 1 – 42. Blázquez, M., Colomina I., 2012. Fast AT: A simple procedure for quasi direct orientation, ISPRS Journal of Photogrammetry and Remote Sensing, 71, pp. 1 – 11. Blom, http://www.blomasa.com/main-menu/products-services/data-models-blomurbex/blomoblique.html, accessed 30.6.2015. Brown, D. C., 1971. Close-range camera calibration, Photogrammetric Engineering, 37(8), pp. 855 – 866. Bäumker, M., Heimes F. J., 2001. New calibration and computing method for direct georeferencing of image and scanner data using the position and angular data of an hybrid inertial navigation system, OEEPE Workshop, Sept. 17th-18th, Hannover, Germany. C-Astral, http://www.c-astral.com/en/products/bramor-c4eye#options, accessed 17.6.2015. Cessna, http://cessna.txtav.com/en/single-engine/special-missions, accessed 17.6.2015. CloudCompare, http://www.cloudcompare.net/, accessed 28.6.2015. Colomina, I., Molina, P., 2014. Unmanned aerial systems for photogrammetry and remote sensing: A review, ISPRS Journal Of Photogrammetry and Remote Sensing, 92, pp. 79 – 97. CompassData, http://www.compassdatainc.com/ground_control_points.htm, accessed 29.6.2015. CoordTrans, http://coordtrans.fgi.fi/index.jsp, accessed 28.6.2015. Cramer, M., Grenzdörffer, G., Honkavaara, E., 2010. In situ digital airborne camera validation and certification – the future standard?, ISPRS Archives, volume XXXVIII, part 1. DART Aerospace, http://www.dartaerospace.com/specialty-equipment/d350-602-013-airbus-heli-utility-pod?view=1, accessed 24.6.2015. Diamond Airborne Sensing, http://www.diamond-sensing.com/index.php?id=da42mppguardian, accessed 16.6.2015. DiNelly Aerosystems, http://exogyro.dinelly.com/, accessed 20.6.2015. Eisenbeiß, H., 2009. UAV photogrammetry, doctoral dissertation, ETH Zurich Switzerland, no. 18515, 235 p. El-Sheimy, N., 2009. Georeferencing component of LiDAR systems, in J. Shan, C. K. Toth, eds., Topographic laser ranging and scanning: principles and processing, Taylor & Francis Group, pp. 195 – 214. Falcon Unmanned, http://www.falconunmanned.com/falcon-falcon/, accessed 16.6.2015. FGI, http://euref-fin.fgi.fi/fgi/en/positioning-service, accessed 29.6.2015.

Page 13: OBLIQUE AERIAL PHOTOGRAPHS - AN “OLD-NEW” DATA SOURCE · was based on horizontal and oblique photographs (Slama, 1980). Although man reached the sky in hot-air balloons already

13

Fischler, M. A., Bolles, R. C., 1981. Random Sample Consensus: A paradigm for model fitting with applications to image analysis and automated cartography, Communications of the ACM, 24(6), pp. 381 – 395. FlyTech Solutions, http://www.flytechuav.pl/en/products/ft02, accessed 16.6.2015. Fritsch, D., Rothermel, M., 2013. Oblique image data processing – potential, experiences and recommendations, in D. Fritsch, editor, Photogrammetric Week ´13, Wichmann. Fugro, http://www.fugrogeospatial.com/expertise/aerial-mapping/panoramix_oblique_imagery/, accessed 30.6.2015. FugroViewer, http://www.fugroviewer.com/, accessed 29.9.2015. Galaxy Blimps, http://www.galaxyblimps.com/outdoor30.html, accessed 19.6.2015. GEFA-FLUG, http://www.gefa-flug.de/index.php?article_id=21&clang=1, accessed 19.6.2015. Geniviva, A. M., Faulring, J., Salvaggio, C., 2014. Automatic georeferencing of imagery from high-resolution, low-altitude, low-cost aerial platforms, in proceedings of SPIE Vol. 9089, 90890D. Geospan, http://www.geospan.com/product-api.asp, accessed 28.9.2015. GeoTrim, http://www.geotrim.fi/index.php/palvelut/trimnet-vrs, accessed 29.6.2015. Gerke, M., Kerle, N., 2011. Automatic structural seismic damage assessment with airborne oblique Pictometry© imagery, Photogrammetric Engineering & Remote Sensing, 77(9), pp. 885 – 898. Grenzdörffer, G. J., 2008. Medium format digital cameras - a EuroSDR project, ISPRS Archives, volume XXXVII, part B1, pp. 1043 – 1050. Grenzdörffer, G. J., Guretzki, M., Friedlander, I., 2008. Photogrammetric image acquisition and image analysis of oblique imagery, The Photogrammetric Record, 23(124), pp. 372 – 386. Gruber, M., Walcher, W., 2013. Oblique image collection – challenges and solutions, in D. Fritsch, editor, Photogrammetric Week ´13, Wichmann. Gyron, www.gyron.com, accessed 24.6.2015. Haala, N., 2013. The landscape of dense image matching algorithms, Photogrammetric Week ´13, Fritsch D., (editor), Wichmann, pp. 271 - 284. Harwin, S., Lucieer, A., 2012. Assessing the accuracy of georeferenced point clouds produced via multi-view stereopsis from unmanned aerial vehicle (UAV) imagery, Remote Sensing, 4(6), pp. 1573 – 1599. Hirschmüller, H., 2011. Semi-Global Matching – motivation, developments and applications, Photogrammetric Week ´11, Fritsch D., (editor), Wichmann, pp. 173 - 184.

Page 14: OBLIQUE AERIAL PHOTOGRAPHS - AN “OLD-NEW” DATA SOURCE · was based on horizontal and oblique photographs (Slama, 1980). Although man reached the sky in hot-air balloons already

14

Honkavaara, E., Arbiol, R., Markelin, L., Martinez, L., Cramer, M., Bovet, S., Chandelier, L., Ilves, R., Klonus, S., Marshal, P., Schläpfer, D., Tabor, M., Thom, C., Veje, N., 2009. Digital airborne photogrammetry ̶ a new tool for quantitative remote sensing? ̶ A state-of-the-art review on radiometric aspects of digital photogrammetric images, Remote Sensing, 1(3), pp. 577 – 605. Hood Tech Vision, http://www.hoodtechvision.com/, accessed 24.6.2015. Höhle, J., 2008. Photogrammetric measurements in oblique aerial images, Photogrammetrie, Fernerkundung, Geoinformation, (1), pp. 7 – 14. ICAROS, http://www.icaros.us/product-brochures/, accessed 30.6.2015. Idan, http://www.idan.com/#!oblivision/c9cr, accessed 30.6.2015. IGI, 2015. Quattro DigiCAM, http://www.igi.eu/quattro-digicam.html, accessed 31.5.2015. iMAR Navigation, http://www.imar-navigation.de/index.php/en/products/by-product-names/item/inat-m200-advanced-mems-based-navigation-surveying-control-system, accessed 27.9.2015. Jacobsen, K., 2008. Calibration of camera systems, in the Proceedings of ASPRS Annual Conference, Portland, Oregon, USA. Jurisch, A., Mountain, D., 2008. Evaluating the viability of Pictometry® imagery for creating models of the built environment. In Proceedings of the International Conference on Computational Science and Its Applications - ICCSA 2008, Part I, Lecture Notes in Computer Science (LNCS), Vol. 5072, pp. 663 – 677, Springer-Verlag Berlin Heidelberg. Kalinski, http://geospatial-solutions.com/oblique-imagery-the-new-kids-on-the-block/, accessed 30.6.2015. Karara, H. M. (editor-in-chief), 1989. Non-topographic photogrammetry, 2nd edition, American Society for Photogrammetry and Remote Sensing, 445 p. Kemper, G., 2012. New airborne sensors and platforms for solving specific tasks in remote sensing, Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci., XXXIX-B5, pp. 351 - 356. Kerle, N., Stekelenburg, R., 2004. Advanced structural disaster damage assessment based on aerial oblique video imagery and integrated auxiliary data sources, ISPRS Archives, Volume XXXV, part B7, pp. 580 – 585. Kisa, A., Ozmus, L., Erkek, B., Ates, H. B., Bakici S., 2013. Oblique photogrammetry and usage on land administration, International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Volume XL-2/W2, ISPRS 8th 3DGeoInfo Conference & WG II/2 Workshop, 27th – 29th November, Istanbul, Turkey. Kraus, K., 1993. Photogrammetry, volume 1, 4th edition, Dümmler, Bonn, Germany, 397 p.

Page 15: OBLIQUE AERIAL PHOTOGRAPHS - AN “OLD-NEW” DATA SOURCE · was based on horizontal and oblique photographs (Slama, 1980). Although man reached the sky in hot-air balloons already

15

Kumar, R., Sawhney, H., Samarasekera, S., Hsu, S., Tao, H., Guo, Y., Hanna, K., Pope, A., Wildes, R., Hirvonen, D., Hansen, M., Burt, P., 2001. Aerial video surveillance and exploitation, Proceedings of the IEEE, 89(10), pp. 1518 – 1539. LAStools, http://rapidlasso.com/lastools/, accessed 28.6.2015. Leica, http://en.leica-camera.com/content/download/94076/784503/version/7/file/The+new+S+brochure_en.pdf, accessed 20.6.2015. Lemmens, M., Lemmen, C., Wubbe, M., 2008. Pictometry: potentials for land administration, International Federation of Surveyors, Article of the Month, May 2008. Lisein, J., Pierrot-Deseilligny, M., Bonnet, S., Lejeune, P., 2013. A photogrammetric workflow for the creation of a forest canopy height model from small unmanned aerial system imagery, Forests, 4(4), pp. 922 – 944. Lyon, D., 1959. Basic metrical photogrammetry, Volume 1, John S. Swift Company, Missouri, USA. Madani, M., 2012. Accuracy potential and applications of MIDAS aerial oblique camera system, International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Volume XXXIX-B1, XXII ISPRS Congress, 25th August – 1st September, Melbourne, Australia. MarcusUAV, http://www.marcusuav.com/, accessed 16.6.2015. Marsella, M., Nardinocchi, C., Proietti, C., Daga, L., Coltelli, M., 2014. Monitoring active volcanos using aerial images and the Orthoview tool, Remote Sensing, 6(12), pp. 12166 - 12186. Megyesi, Z., 2009. Dense matching methods for 3D scene reconstruction from wide baseline images, PhD dissertation, Eötvös Loránd University, Budabest, Hungary, 140 p. Meixner, P., Leberl, F., 2010. Vertical or oblique photography for semantic building interpretation, Publ. der Deutschen Ges. für Photogrammetrie, Fernerkundung und Geoinformation e.V., Vol. 19, Vorträge Dreiländertagung OVG, DGPF und SGPF, pp. 247 – 256. Meixner, P., Leberl, F., 2011. 3-dimensional building details from aerial photography for Internet maps, Remote Sensing, 3(4), pp. 721 – 751. Merchant, D. C., Schenk, A., Habib, A., Yoon, T., 2004. USGS/OSU progress with digital camera in situ calibration methods, ISPRS Archives, volume XXXV, Part B2, pp. 19 – 24. Microdrones, http://www.microdrones.com/en/products/md4-200/at-a-glance/, accessed 19.6.2015. Mikhail, E. M., Bethel, J. S., McGlone, J. C., 2001. Introduction to Modern Photogrammetry, John Wiley & Sons Inc., 479 p.

Page 16: OBLIQUE AERIAL PHOTOGRAPHS - AN “OLD-NEW” DATA SOURCE · was based on horizontal and oblique photographs (Slama, 1980). Although man reached the sky in hot-air balloons already

16

MMIST, http://www.mmist.ca/pg_ProductsSnowGooseAircraftCQ10B.php, accessed 20.6.2015. Morel, J.-M., Yu, G., 2009. ASIFT: A new framework for fully affine invariant image comparison, SIAM Journal on Imaging Sciences, 2(2), pp. 438 - 469. Murtiyoso, A., Remondino, F., Rupnik, E., Nex, F., Grussenmeyer, P., 2014. Oblique aerial photography tool for building inspection and damage assessment, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Volume XL-1, ISPRS Technical Commission I Symposium, 17th – 20th November, Denver, Colorado, USA. Nimbus Dirigibles, http://nimbusdirigibles.com/en/dirigibles-de-exterior/, accessed 19.6.2015. Nocerino, E., Menna, F., Remondino, F., 2012. Multi-temporal analysis of landscapes and urban areas, International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Volume XXXIX-B4, pp. 85 – 90. Novatel, http://www.novatel.com/products/span-gnss-inertial-systems/span-imus/span-mems-imus/imu-igm-s1/, accessed 28.9.2015. Nurminen, K., Litkey, P., Honkavaara, E., Vastaranta, M., Holopainen, M., Lyytikäinen-Saarenmaa, P., Kantola, T., Lyytikäinen, M., 2015. Automation aspects for the georeferencing of photogrammetric aerial image archives in forested scenes, Remote Sensing, 7(2), pp. 1565 – 1593. Nyaruhuma, A. P., Gerke, M., Vosselman, G., Mtalo E. G., 2012. Verification of 2D building outlines using oblique airborne images, ISPRS Journal of Photogrammetry and Remote Sensing, 71, pp. 62 – 75. Ofek, http://www.ofek-air.com/en/products/ofek-multivision/ofek-multivision, accessed 30.6.2015. PCI Geomatics, http://www.pcigeomatics.com/pdf/geomatica/tutorials/Chip_Manager.pdf, accessed 29.6.2015. Petrie G., 2009. Systematic Oblique Aerial Photography Using Multiple Digital Frame Cameras, Photogrammetric Engineering & Remote Sensing, 75(2), pp. 102 – 107. Petrie G., 2012. Visual Intelligence’s Iris One Airborne Camera Systems, GEO Informatics, 15(6), pp. 30 – 36. Phase One, http://industrial.phaseone.com/iXA-r_camera_system.aspx, accessed 20.6.2015. Piaggio Aerospace, http://www.piaggioaerospace.it/en/business-aviation, accessed 16.6.2015. Pictometry, http://www.eagleview.com/Products/ImageSolutionsAnalytics/PictometryAnalyticsDeployment.aspx, accessed 28.9.2015. Pictorvision, http://www.pictorvision.com/, accessed 24.6.2015.

Page 17: OBLIQUE AERIAL PHOTOGRAPHS - AN “OLD-NEW” DATA SOURCE · was based on horizontal and oblique photographs (Slama, 1980). Although man reached the sky in hot-air balloons already

17

Prandi, F., Achille, C., Brumana, R., Fassi, F., Fregonese, L., 2008. LIDAR and Pictometry images integrated use for 3d model generation, ISPRS Archives, volume XXXVII, part B2, pp. 763 – 770. Rasika, A. K., Kerle, N., Heuel, S., 2006. Multi-scale texture and color segmentation of oblique airborne video data for damage classification, ISPRS Archives, volume XXXVI, part 7. Redecker, A. P., 2008. Historical aerial photographs and digital photogrammetry for impact analyses on derelict land sites in human settlement areas, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, volume XXXVII, part B8, pp. 5 - 10. Rehak, M., Mabillard, R., Skaloud, J., 2013. A micro-UAV with the capability of direct georeferencing, ISPRS Archives, volume XL-1/W2, pp. 317 – 323. Remondino, F., 2006. Detectors and descriptors for photogrammetric applications, ISPRS Archives, volume XXXVI, part 3. Remondino, F., Fraser, C., 2006. Digital camera calibration methods: considerations and comparisons, in proceedings of the ISPRS Commission V Symposium 'Image Engineering and Vision Metrology' September 25th – 27th , Dresden, Germany, pp. 266 – 272. Rothermel, M., Wenzel, K., Fritsch, D., Haala, N., 2012. SURE: Photogrammetric surface reconstruction from imagery, in proceedings of LC3D Workshop, Berlin, pp. 1 - 9. Rupnik, E., Jansa, J., 2014. Off-the-shelf videogrammetry – a success story, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Volume XL-3/W1, EuroCOW 2014, the European Calibration and Orientation Workshop, 12th – 14th February 2014, Castelldefels, Spain. Rupnik, E., Nex, F., Remondino, F., 2014. Oblique Multi-camera systems – orientation and dense matching issues, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Volume XL-3/W1, EuroCOW 2014, the European Calibration and Orientation Workshop, 12th – 14th February 2014, Castelldefels, Spain. Sanborn, http://www.sanborn.com/oblique-analyst/, accessed 28.9.2015. Schenk T., 1999. Digital Photogrammetry, Volume I, TerraScience, 428 p. Schowengerdt, R. A., 1997. Remote sensing: Models and methods for image processing, 2nd edition, Academic Press, 522 p. senseFly, https://www.sensefly.com/fileadmin/user_upload/documents/brochures/eBee_en.pdf, accessed 16.6.2015. Shortis, M. R., Ogleby, C. L., 1988. Applications of low altitude photogrammetry to digital mapping and heritage recording. ISPRS Archives ̶ Volume XXVII Part B5, XVIth ISPRS Congress, July 1st – 10th, Kyoto, Japan, pp. 557 – 566.

Page 18: OBLIQUE AERIAL PHOTOGRAPHS - AN “OLD-NEW” DATA SOURCE · was based on horizontal and oblique photographs (Slama, 1980). Although man reached the sky in hot-air balloons already

18

Shragai, Z., Even-Paz, A., Klein, I., 2011. Automatic tie-point extraction using advanced approaches, in proceedings of ASPRS Annual Conference, Milwaukee, Wisconsin, USA. SkyImd, http://www.skyimd.com/aerial_imaging_pod.html, accessed 24.6.2015. Slama, C. C., 1980. Manual of Photogrammetry, 4th edition, American Society of Photogrammetry, 1056 p. Spacemetric, http://www.spacemetric.com/model-parameter-adjustment/, accessed 29.6.2015. Swift Navigation, http://www.swiftnav.com/index.html, accessed 26.9.2015. Tang, R., 2012. A rigorous and flexible calibration method for digital airborne camera systems, International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, volume XXXIX-B1, pp. 153 – 158. Thompson, M. M., 1966. Manual of Photogrammetry, Volume II, 3rd edition, American Society of Photogrammetry, 663 p. Tola, E., Lepetit, V., Fua, P., 2008. A fast local descriptor for dense matching, in proceedings of IEEE Conference on Computer Vision and Pattern Recognition, Alaska, USA. Tommaselli, A. M. G., Galo, M., de Moraes, M. V. A., Marcato, J. Jr., Caldeira, C. R. T., Lopes, R. F., 2013. Generating virtual images from oblique frames, Remote Sensing, 5(4), pp. 1875 – 1893. Vallas, http://www.lentokuva.fi/, accessed 28.6.2015. Vallet, J., 2007. GPS/IMU and LiDAR integration to aerial photogrammetry: Development and practical experiences with Helimap System®, Dreiländertagung 2007 SGPBF-DGPF-OVG. Vantaa, http://kartta.vantaa.fi/, accessed 28.6.2015. Vassilaki, D.; Ioannidis, C.; Stamos, A., 2012. Recovery of the geometry of historical aerial photos associating self-calibration with ground control linear features, in Proceedings of the 1st EARSeL Workshop on Temporal Analysis of Satellite Images, Mykonos, Greece, 23rd – 25th May, pp. 202 - 207. Verhoeven, G., Wieser, M., Briese, C., Doneus, M., 2013. Positioning in time and space – cost-effective exterior orientation for airborne archaeological photographs, ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Volume II-5/W1, pp. 313 – 318. Vulcanair, http://www.vulcanair.com/files/files/special_missions_p68_obs_25-03-14.pdf, accessed 16.6.2015. Walstra, J., 2006. Historical aerial photographs and digital photogrammetry for landslide assessment, a doctoral thesis, Loughborough University.

Page 19: OBLIQUE AERIAL PHOTOGRAPHS - AN “OLD-NEW” DATA SOURCE · was based on horizontal and oblique photographs (Slama, 1980). Although man reached the sky in hot-air balloons already

19

Wang, Y., Schultz, S., Giuffrida, F., 2008. Pictometry’s proprietary airborne digital imaging system and its application in 3D city modelling, ISPRS Archives, volume XXXVII, part B1, pp. 1065 – 1070. Wei, L., 2009. Low-altitude unmanned airship photogrammetry system, ISPRS Archives ̶ Volume XXXVIII-7/C4, International Conference on Geo-spatial Solutions for Emergency Management and the 50th Anniversary of the Chinese Academy of Surveying and Mapping, 14th – 16th September, China, pp. 165 – 168. Wolf, P. R., 1974. Elements of Photogrammetry, International Student Edition, McGraw-Hill Inc. Wu C., Agarwal S., Curless B., Seitz S. M., 2011. Multicore bundle adjustment, in proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 20th June -25th June, Colorado Springs, Colorado, USA, pp. 3057 – 3064. Wu C., 2013. Towards linear-time incremental structure from motion, in proceedings of International Conference on 3D Vision, 29th June – 1st July, Seattle, Washington, USA, pp. 127 – 134. Xiao, J., Gerke, M., Vosselman, G., 2012. Building extraction from oblique airborne imagery based on robust façade detection, ISPRS Journal of Photogrammetry and Remote Sensing, 68, pp. 56 – 68. Xsens, https://www.xsens.com/products/mti-g-700/, accessed 27.9.2015. Zeppelin NT, http://www.zeppelin-nt.com/en/zeppelin-NT/fields-of-application/special-missions/examples-of-special-missions.html, accessed 19.6.2015. Zhang, Y., Zhang, Z., Zhang, J., Wu, J., 2005. 3D building modelling with digital map, lidar data and video image sequences, The Photogrammetric Record, 20(111), pp. 285 – 302. Zhao, H., Zhang, B., Wu, C., Zuo, Z., Chen, Z., Bi, J., 2014. Direct georeferencing of oblique and vertical imagery in different coordinate systems, ISPRS Journal of Photogrammetry and Remote Sensing, 95, pp. 122 – 133.