Wednesday, 18 December 2013

Repatching the RF-container data network

Recently, we discovered a bit of a problem with the recording of high-speed radar data at KAIRA. We have had some problems with the recording of UDP packets via our local data computer kaira01. As part of the testing for the installation of the new QNAP data recorders, we were also testing the UDP packet reception on not just the QNAP box, but also one of the other KAIRA acquisition machines, kaira03. As this work was being done in the RF-container, we were physically in the container and running the software from there.

During this time, we noticed that simultaneous dropped packets on all four lanes would occur at precisely the moment that the air-conditioning cuts in. Suspecting possible power spikes somehow getting into the network we traced the cables. These turned out to be quite long (two were 7.5 m and the other two were 10 m) and surplus length was coiled in the sub-floor space under the racks close to some of the power distribution cables.

We therefore suspect that some packet loss might have been caused by spikes induced into these cables corresponding to power fluctuations. At the time we were checking this, we also noticed that the cables used were CAT-5, which are only rated to 100 Mbit/s.

We have now replaced all four cables with 3-m CAT-6 cables (rated to 1 Gbit/s). These cables route directly through the signal cable guides on the back of the racks and do not go anywhere near the sub-floor space.

Re-patching work in the RF-container (Photo: D. McKay-Bukowski)


We now see a noticeable improvement in packet reliability, although we still see the occasional lost packet.

Tuesday, 17 December 2013

Winter trees

It must be tough being a tree up here at Kilpisjärvi. Dark, cold and windswept. Today's photograph is of a couple of birch trees on the KAIRA site, taken during the midday twilight.

Trees at the KAIRA site during kaamos (Photo: D. McKay-Bukowski)

Monday, 16 December 2013

Perfect Incoherent scatter radar jammer

On November 27th, somebody stepped on our band here at MIT Haystack Observatory. At first I thought that there must be something wrong with the new radar echo deconvolution program that I have been developing. But a month ago the same program worked perfectly, and no major changes were made since then.

On the next day there was a routine radar calibration run, which seemingly looked ok in terms of electron density. However, there was a suspiciously uniform non-zero Doppler velocity across the altitude profile during the whole run.

I went back to the raw voltage and calculated spectra from range gates at ranges where no ionospheric return would be expected. Sure enough, there was strong radio interference right in the middle of our radar band at 440 MHz.
The signal looked like it had ~0.5 ms baud lengths and frequency shift keying modulation on it.


As an emergency plan of action, we considered moving our center frequency to 440.4 MHz to navigate around the jammer. However, by the next day, the jammer had drifted in frequency to 440.4 MHz from 440.2 MHz. In the following days, the signal continued randomly walking  between 439.9 and 440.4 MHz, our whole licensed band. 

Not only was the signal stopping our operations, it also occasionally looked nearly like an F-region ionospheric return, a double humped ion-line spectrum. This is shown in the picture below.
Screen capture while war driving to locate the jammer. Hey, it has a double humped spectrum, just like the F-region ionospheric return, and it has approximately the same width! Frank's comment: "I don't like this jammer".
Because the signal was strong, we suspected something on the observatory grounds might be causing it. However, despite multiple attempts, we failed to pick up the signal with a yagi antenna anywhere on the Hill. Doing an azimuth scan with the MISA antenna suggested that the signal was coming from the south west direction. Because we failed to find the signal on the hill, it was possibly coming from further away.
Azimuth scan of interference on the MISA antenna, indicating that the signal is arriving from the Southwest direction.
At this point, we loaded up a black SUV with a bunch of gear: a directional antenna, an omnidirectional roof mounted antenna, an RF front end (hastily built in a shoe box), and some real-time spectrum analysis software.

Mobile RFI detection unit, with our expert RF gumshoe, Will Rogers.
On the first night, our sleuth Will drove around and caught a weak glimpse of the same jammer signal in Leominster on I-190, about 20 km from our radar. A yagi antenna scan indicated that the signal was coming from further West.
Instrumenting the vehicle. The MISA antenna in the background.
A few days later, a more instrumented war driving expedition took place with Frank Lind, Will Rogers, and Juha Vierinen. This time we had GPS logging and recording of spectra. After a day of direction finding and driving around, we were fairly confident that the source was between Leominster and Mt. Wachusetts in Leominster State Forest, about 30 km from our radar. However, we still failed to locate the source.
RFI signal strength as a function of geographic location.
On the afternoon of the next day, on his way home, Will Rogers stopped by at the hot spot that we had identified near Stuart Pond. He obtained several precise angle measurements using a yagi and a magnetic loop antenna. He also recorded observed signal power. The results are indicated in the picture below.
Angle of arrival measurements.
The results indicated that the source of the interference must be somewhere in the forest, possibly closer to locations 2 and 3, than 1 and 4. After some analysis of the data using satellite and aerial photographs, the only man made object in the forest, a radio tower, was identified. This was a huge relief, as one theory was that the source might be a broken animal tracking collar.
Incoherent scatter radar echo simulator.
This tower was soon identified as a local FM radio station. The engineer responsible for the station informed us that he had a few weeks ago installed a FSK telemetry link operating at 450 MHz. This was consistent with the appearance of the interference. The faulty telemetry link was aptly replaced by the engineer, and the interferer finally went away!

At about 2013.12.13 13:00 LT, the interference finally goes away as faulty telemetry radio link is replaced on the radio mast in Princeton.
During this episode, we learned a lot about radio direction finding in practice. This will come in handy in the future, as interference is abundant at Haystack.

For software, we used the gnuradio framework. We mostly used the waterfall and FFT spectrum graphical sinks, as the signal was drifting around in frequency a lot. For the war driving, I used a custom block that I wrote, which simply calculates power spectra using FFTW, and records averaged results to disk. I then used post processing of this to calculate the RFI power at any given location. I recorded the GPS coordinates with my phone.

Hastily built front end and rtlsdr digital receiver. The other output can be connected to another receiver, such as a USRP, a HAM rig, or a spectrum analyzer. 
For hardware, we used both rtlsdr dongles, and a USRP N200. The rtlsdr dongle and the gnuradio FFT spectrum sink actually worked surprisingly well for direction of arrival determination. The RF front end consisted of a low noise amplifier and a filter. As direction finding antennas, we used two different yagi antennas, and a magnetic loop antenna. For war driving, we first used a roof mounted discone antenna, and later a magnetically mounted quarter wave dipole.

Yagi antenna (above) used to direction finding by maximizing signal power. The magnetic loop antenna (below) is used to find the angle of arrival by minimizing the signal power, as the antenna radiation pattern has a sharp null in the direction of the loop axis.  
I had already prepared software to record absolute time of arrival of the interferer using GPS syncronized USRP receivers at several independent locations. However, good old fashion detective work with directional antennas managed to provide us with enough clues to solve the problem before we got to deploy our time of arrival setup. Well, maybe the software and receivers can be used to hunt down the spike-like interference that we see every now and then.

Sunday, 15 December 2013

Photos from Inverse Days 2013

The 2013 Inverse Days conference was held in Inari Finland at the Sajos Centre. The new and impressive venue is the Sámi Cultural Centre which is situated on the bank of River Juutuanjoki, close to the heart of the town. Sajos is the centre of Sámi culture and administration.

The conference was busy (over 100 participants!) and full a plethora of new ideas and results. It was brilliant in that the technique of inverse problem analysis applies to many branches of science and there was a range of people there from chemists to applied mathematicians to physicists and many more.

The hectic programme, overwhelming logistics and social schedule meant that  we didn't quite manage to take photographs for the web log. However, we did have a few sent to us later by one of the participants (thanks Virpi!) and we'll feature a small selection of them here.


The Sajos Centre at Inari (Photo: V. Junttila)

Inverse in action! Presentation in the main Sajos hall. (Photo: V. Junttila)

Wall decoration in the other hall in the Sajos centre. (Photo: V. Junttila)

Happy participants... the chap second from right is Lassi, the conference organiser. (Photo: V. Junttila)

More inverse action... here Harri is giving his presentation. (Photo: V. Junttila)

Saturday, 14 December 2013

It must have been a good conference...

Here at the KAIRA web log editorial offices (sic) we've been doing a reasonably good job of keeping up the daily posting of articles, photographs, news and videos. It is a lot of work, but we've always managed to keep on top of it.

However, these last few days, we've slipped behind and there has now been a couple of days where nothing was posted. In fact, for the first time in ages, we've even missed our Friday Photograph.   :-(

Well, to be fair, this can only be attributed to the excellent Inverse Days 2013 conference in Inari, Finland... organised by none other than KAIRA's regular contributor: Lassi Roininen.



We'll get back to our regular posts again tomorrow (including photographs from the conference itself!). And next week we have a brilliant article lined up, with loads of photographs and a very mysterious story behind it.

Wednesday, 11 December 2013

Inverse Days 2013 at Inari

Today, the venue for Inverse Days 2013 has moved to Inari. The conference centre is the Sami Cultural Centre... a lovely building with a very distinct architecture.

Sami Centre, Inari

Tuesday, 10 December 2013

Inverse Days: Thematic day on geospace and atmospheric research

Today is the first day of the Inverse Days, an annual event of the Finnish Inverse Problems Society.  The 19th Inverse Days 2013 comprises of two events:
  1. Thematic day on geospace and atmospheric research in Sodankylä 10th Dec.
  2. Traditional Inverse Days in Inari 11th-13th Dec.
This year's event is characterised by extreme temperature variations between -40 and +3 degrees Celsius. We have had at least one recorded car engine breakdown due to extreme cold. Another maybe also (some smoke coming from the engine)... Anyway, after extreme cold, we will head to plus degrees, which typically results plumbing problems in urban areas! However scientific programme will continue as scheduled!

For more info on the Inverse Days, please visit the event website!
Saariselkä plateau, which we will pass on Tuesday!