You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-12 - 05:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8s.osadl.org (updated Thu Mar 12, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2344499913420,1338cyclictest6191692sleep323:34:563
2344499913180,1314cyclictest5275162sleep322:35:003
2344499912120,1204cyclictest4355002sleep321:35:023
2344499912040,1195cyclictest5272612sleep322:34:573
234449992910,287cyclictest370193-21turbostat20:54:553
32362121960,1sleep0471rcuog/220:15:000
3422392360,2sleep0171rcu_preempt20:25:170
23444999211,16cyclictest263205-21turbostat19:30:003
3452992200,2sleep014-21ksoftirqd/020:30:140
23444999191,15cyclictest330190-21turbostat20:20:003
23444999181,13cyclictest356869-21turbostat20:40:003
23444999180,15cyclictest711084-21taskset00:35:043
23444999175,9cyclictest323535-21turbostat20:14:593
23444999171,13cyclictest672074-21taskset00:07:583
23444999171,13cyclictest518595-21taskset22:26:153
23444999171,13cyclictest0-21swapper/322:10:123
23444999171,12cyclictest433470-21taskset21:30:203
173198170,4rtkit-daemon566039-21df_inode23:00:130
2548582161,12sleep1255507-21head19:20:161
23444999167,7cyclictest383501-21turbostat21:04:563
234449991613,1cyclictest0-21swapper/323:53:243
234449991613,1cyclictest0-21swapper/321:54:493
23444999161,1cyclictest0-21swapper/323:43:373
23444999161,12cyclictest708984-21taskset00:30:183
23444999161,12cyclictest664379-21taskset00:02:373
23444999161,12cyclictest610732-21taskset23:26:473
23444999161,12cyclictest603101-21taskset23:21:533
23444999161,12cyclictest580353-21taskset23:07:343
23444999161,12cyclictest457843-21taskset21:48:393
23444999161,12cyclictest450260-21taskset21:43:593
23444999161,12cyclictest237221-21taskset19:10:173
23444999161,12cyclictest0-21swapper/322:20:213
23444999160,2cyclictest0-21swapper/319:35:003
23444999160,13cyclictest641086-21taskset23:46:183
23444999160,13cyclictest383475-21chrt20:59:583
23444999151,2cyclictest0-21swapper/321:55:143
23444999151,2cyclictest0-21swapper/321:20:123
23444999151,2cyclictest0-21swapper/321:20:113
23444999151,2cyclictest0-21swapper/320:05:123
23444999151,2cyclictest0-21swapper/300:15:123
234449991512,1cyclictest0-21swapper/322:06:383
23444999151,1cyclictest0-21swapper/320:05:013
23444999151,12cyclictest657033-21taskset23:58:573
23444999151,11cyclictest564506-21taskset22:56:083
23444999151,11cyclictest396761-21taskset21:09:083
23444999151,11cyclictest340044-21taskset20:25:163
23444999151,11cyclictest296833-21sleep19:55:013
23444999151,11cyclictest290148-21taskset19:49:423
23444999151,11cyclictest0-21swapper/322:50:113
23444999151,11cyclictest0-21swapper/322:44:313
23444999151,11cyclictest0-21swapper/321:10:123
23444999151,11cyclictest0-21swapper/320:40:183
23444999151,11cyclictest0-21swapper/320:20:123
23444999151,11cyclictest0-21swapper/319:40:103
23444999151,11cyclictest0-21swapper/300:10:203
23444999150,12cyclictest426201-21taskset21:25:473
23444999150,11cyclictest249856-21turbostat19:20:003
7126912141,3sleep0714627-21kthreadcore00:35:170
23444999141,3cyclictest0-21swapper/319:35:113
23444999141,2cyclictest0-21swapper/322:15:123
23444999141,2cyclictest0-21swapper/320:45:123
23444999141,2cyclictest0-21swapper/300:20:103
234449991412,0cyclictest0-21swapper/319:24:243
23444999141,11cyclictest0-21swapper/322:00:123
234449991411,1cyclictest0-21swapper/321:19:203
23444999141,11cyclictest0-21swapper/319:55:113
23444999141,10cyclictest587488-21chrt23:10:443
23444999140,11cyclictest595195-21taskset23:15:483
23444999140,11cyclictest349826-21taskset20:30:423
23444999140,11cyclictest0-21swapper/323:35:203
23444999140,11cyclictest0-21swapper/323:00:223
23444999140,11cyclictest0-21swapper/322:45:173
23444999140,11cyclictest0-21swapper/300:25:143
5950342130,4sleep134-21ksoftirqd/123:15:271
4048402131,4sleep2404999-21diskstats21:15:142
3715172131,9sleep10-21swapper/120:50:161
2891822131,9sleep1289238-21ntpq19:45:211
2333902130,7sleep0233442-21ntpq19:05:210
6264142121,8sleep1626416-21ssh23:38:311
5496932121,3sleep2549695-21ssh22:47:562
4955572121,2sleep1171rcu_preempt22:11:511
3499952121,5sleep2643-21snmpd20:32:552
173198120,7rtkit-daemon573705-21apt-get23:05:110
7101552111,2sleep20-21swapper/200:32:272
5035682110,8sleep1503570-21ssh22:17:161
4731912111,7sleep0396838-21diskmemload21:58:560
3918412111,2sleep00-21swapper/021:05:170
2399652110,8sleep1240059-21ntpq19:10:201
6785192101,6sleep10-21swapper/100:10:221
6576012101,6sleep0657605-21ssh00:00:030
6424002101,6sleep00-21swapper/023:50:130
5792302101,5sleep1579282-21ntp_states23:05:211
5361382101,6sleep10-21swapper/122:40:161
5024912101,5sleep2502545-21ntpq22:15:212
4768902100,7sleep2478993-21cut22:00:182
4364582100,7sleep0437473-21grep21:35:150
4124482101,5sleep0412601-21df_inode21:20:120
4124482101,5sleep0412601-21df_inode21:20:120
3727092101,6sleep2374805-21kthreadcore20:50:172
3104472102,4sleep0310469-21apt-get20:05:120
2705942101,5sleep2270720-21hddtemp_smartct19:35:132
2690032101,5sleep0269045-21ntpq19:30:210
2333382101,5sleep30-21swapper/319:05:213
173198100,6rtkit-daemon549879-21ssh22:48:340
173198100,6rtkit-daemon396838-21diskmemload22:16:590
173198100,5rtkit-daemon670766-21ntpq00:05:180
173198100,5rtkit-daemon500-21gmain00:20:480
173198100,5rtkit-daemon487050-21ntpq22:05:222
173198100,5rtkit-daemon256794-21apt-get19:25:130
173198100,1rtkit-daemon0-21swapper/020:18:010
686924290,7sleep1686928-21ssh00:16:141
659903291,5sleep1661910-21kthreadcore00:00:151
612360290,6sleep2613315-21cut23:30:152
610391291,5sleep1610395-21ssh23:25:331
604262291,5sleep0604419-21diskstats23:25:120
603823290,1sleep00-21swapper/023:24:320
588102294,3sleep0396838-21diskmemload23:12:580
527560291,4sleep0527593-21apt-get22:35:110
480312290,1sleep00-21swapper/022:02:000
450326290,6sleep1450330-21ssh21:44:151
427090290,1sleep1427094-21ssh21:29:081
383762291,4sleep2383784-21apt-get21:00:112
370167290,6sleep1370207-21sh20:50:011
369215291,5sleep2369264-21ntpq20:45:212
352071290,6sleep0354065-21cut20:35:170
330447291,4sleep2330480-21apt-get20:20:132
323772291,4sleep1323804-21apt-get20:15:141
289245291,5sleep2289305-21grep19:45:222
243415291,4sleep1243450-21apt-get19:15:111
17319890,5rtkit-daemon718339-21ssh00:39:341
17319890,5rtkit-daemon535555-21hddtemp_smartct22:40:140
17319890,5rtkit-daemon457367-21ssh21:46:562
17319890,5rtkit-daemon396838-21diskmemload21:12:151
17319890,3rtkit-daemon649-21ntpd00:10:020
17319890,2rtkit-daemon0-21swapper/019:36:540
17319890,1rtkit-daemon1730-21rtkit-daemon21:56:491
716453280,4sleep2716598-21awk00:35:202
665615284,2sleep20-21swapper/200:05:132
641663280,5sleep0396838-21diskmemload23:48:250
610449280,1sleep20-21swapper/223:25:472
558232281,3sleep0558234-21apt-get22:55:100
534654280,2sleep1534658-21ssh22:39:011
527266281,4sleep1527299-21awk22:34:591
525554280,6sleep0525601-21/usr/sbin/munin22:30:210
511386280,1sleep00-21swapper/022:22:530
510163281,4sleep2510213-21ntpq22:20:222
489486280,5sleep2490485-21kthreadcore22:10:162
484529280,5sleep0486587-21ssh22:05:180
442562280,5sleep1442564-21ssh21:38:461
435251281,4sleep1435276-21basename21:35:001
411251280,2sleep1411255-21ssh21:16:491
403349280,5sleep2403353-21ssh21:10:442
395942280,4sleep1395985-21ntp_states21:05:221
329228281,4sleep2329277-21ntpq20:15:232
304079280,5sleep2304170-21irqcore20:00:162
263747281,4sleep1263845-21grep19:30:141
250481281,4sleep2251480-21irqstats19:20:142
248889281,3sleep2248933-21ntpq19:15:212
240061280,4sleep2240110-21ntpq19:10:212
233191281,4sleep2233331-21ntpq19:05:192
17319880,4rtkit-daemon647-21lldpd19:49:060
17319880,4rtkit-daemon643-21snmpd22:26:540
17319880,4rtkit-daemon643-21snmpd20:20:120
17319880,4rtkit-daemon643-21snmpd19:55:120
17319880,4rtkit-daemon453-21wpa_supplicant23:41:371
17319880,4rtkit-daemon453-21wpa_supplicant23:15:360
17319880,4rtkit-daemon453-21wpa_supplicant19:52:170
17319880,4rtkit-daemon449928-21ssh21:42:392
17319880,4rtkit-daemon419388-21ssh21:23:381
17319880,4rtkit-daemon419388-21ssh21:23:381
17319880,4rtkit-daemon194099-21munin-node19:11:040
17319880,3rtkit-daemon649-21ntpd23:37:140
17319880,1rtkit-daemon0-21swapper/120:57:471
680191270,4sleep2680193-21ssh00:14:402
664964270,2sleep2664968-21ssh00:04:532
655691271,4sleep1655829-21ssh23:55:241
651386271,3sleep2653005-21grep23:55:172
649081270,5sleep1649085-21ssh23:52:381
626364271,4sleep20-21swapper/223:38:202
617409270,4sleep0617463-21ntp_states23:30:220
565094270,1sleep10-21swapper/122:58:241
548469271,3sleep1548523-21ntpq22:45:221
514630270,4sleep1516626-21grep22:25:171
494630271,3sleep0494670-21ntpq22:10:220
466429271,3sleep2466864-21irqcore21:55:172
456387271,3sleep0456437-21ntpq21:45:210
442654270,5sleep2442658-21ssh21:39:072
433415270,3sleep2433463-21ntpq21:30:202
431928271,3sleep0433272-21memory21:30:180
420222270,4sleep0420349-21hddtemp_smartct21:25:140
384062270,5sleep1384197-21irqcore21:00:141
377453270,4sleep2378449-21irqstats20:55:142
356634270,3sleep10-21swapper/120:37:231
342421271,2sleep1342524-21ntpq20:25:191
303357270,3sleep20-21swapper/219:58:242
297057271,3sleep1297090-21apt-get19:55:101
263850270,1sleep20-21swapper/219:30:152
262301271,3sleep2262343-21ntpq19:25:232
17319870,4rtkit-daemon647-21lldpd23:46:552
17319870,4rtkit-daemon643-21snmpd19:21:460
17319870,4rtkit-daemon500-21gmain21:53:131
17319870,3rtkit-daemon709115-21ntpq00:30:210
17319870,3rtkit-daemon702019-21pool-udisksd00:25:310
17319870,3rtkit-daemon651533-21kthreadcore23:55:160
17319870,3rtkit-daemon649-21ntpd19:15:200
17319870,3rtkit-daemon627434-21smartctl23:40:140
17319870,3rtkit-daemon553520-21kthreadcore22:50:180
17319870,3rtkit-daemon396838-21diskmemload21:50:222
17319870,3rtkit-daemon396838-21diskmemload00:17:090
17319870,3rtkit-daemon241207-21munin-node20:41:051
693858260,3sleep2396838-21diskmemload00:20:202
690407260,4sleep1692297-21ssh00:20:151
633870260,3sleep2633874-21ssh23:42:502
602150260,1sleep10-21swapper/123:20:201
589268260,3sleep2589452-21cut23:15:172
587797260,4sleep20-21swapper/223:11:512
573022261,2sleep20-21swapper/223:04:392
564761261,2sleep2564765-21ssh22:57:042
550537260,3sleep2550572-21apt-get22:50:112
505456260,4sleep1506298-21kthreadcore22:20:171
475195261,2sleep10-21swapper/122:00:171
457319260,4sleep10-21swapper/121:46:461
426600260,1sleep20-21swapper/221:27:162
411560260,1sleep00-21swapper/021:17:570
383436260,4sleep00-21swapper/020:59:280
368308260,1sleep00-21swapper/020:45:180
337113260,4sleep20-21swapper/220:25:122
316742260,4sleep10-21swapper/120:08:301
272325260,4sleep1274350-21kthreadcore19:35:161
17319860,3rtkit-daemon649-21ntpd20:00:580
17319860,3rtkit-daemon643-21snmpd22:07:211
17319860,2rtkit-daemon277148-21apt-get19:40:100
17319860,1rtkit-daemon1730-21rtkit-daemon23:45:081
710690250,3sleep1710692-21ssh00:34:301
696212250,2sleep20-21swapper/200:25:182
686888250,2sleep20-21swapper/200:16:032
648500250,2sleep2648502-21ssh23:50:272
612196251,2sleep1612358-21irqcore23:30:151
587461250,3sleep1587463-21ssh23:10:381
574001251,2sleep20-21swapper/223:05:142
572020250,2sleep10-21swapper/123:00:451
557310250,3sleep10-21swapper/122:52:471
536777250,2sleep20-21swapper/222:40:172
530448251,2sleep20-21swapper/222:35:162
519935250,3sleep2520090-21ssh22:30:122
459878250,2sleep00-21swapper/021:50:190
397116250,1sleep00-21swapper/021:10:100
370422250,2sleep00-21swapper/020:50:120
362597250,2sleep20-21swapper/220:40:192
350733250,2sleep2351107-21irqcore20:35:142
323333250,3sleep1643-21snmpd20:12:411
318962250,2sleep20-21swapper/220:10:182
316515250,1sleep20-21swapper/220:05:342
307508251,1sleep10-21swapper/120:00:191
290420250,2sleep20-21swapper/219:50:072
282695250,2sleep20-21swapper/219:40:212
282640250,2sleep10-21swapper/119:40:211
702026240,2sleep1702030-21ssh00:25:331
672307240,2sleep1672311-21ssh00:08:491
602933240,2sleep2602937-21ssh23:21:092
518424240,2sleep2518428-21ssh22:25:382
443207240,1sleep00-21swapper/021:40:130
418045240,2sleep2418101-21ssh21:20:232
418045240,2sleep2418101-21ssh21:20:222
396760240,3sleep20-21swapper/221:09:082
335567240,2sleep1335827-21strings20:20:201
234191240,1sleep10-21swapper/119:08:421
389302230,1sleep00-21swapper/021:00:210
357392230,1sleep00-21swapper/020:40:130
349290230,1sleep10-21swapper/120:30:201
290615230,1sleep10-21swapper/119:50:141
258142230,1sleep10-21swapper/119:25:181
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional