You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-11 - 00:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5s.osadl.org (updated Sun May 10, 2026 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1334199270,26cyclictest1207-21ssh09:32:543
1334199270,21cyclictest0-21swapper/309:41:493
1334199270,0cyclictest0-21swapper/312:31:043
1333899270,27cyclictest0-21swapper/212:34:162
1333899270,26cyclictest774-21runrttasks12:01:152
1333899270,1cyclictest23523-21perf10:50:012
13341992621,4cyclictest0-21swapper/310:52:053
13341992620,5cyclictest32183-21ssh10:28:153
13341992620,5cyclictest0-21swapper/311:26:553
1334199260,25cyclictest6696-21diskmemload12:29:403
1334199260,25cyclictest0-21swapper/309:48:213
1334199260,25cyclictest0-21swapper/309:48:213
1334199260,21cyclictest13325-21cyclictest11:36:043
1334199260,1cyclictest0-21swapper/311:14:493
1334199260,1cyclictest0-21swapper/310:00:373
1334199260,1cyclictest0-21swapper/309:59:063
1334199260,0cyclictest0-21swapper/311:24:553
1334199260,0cyclictest0-21swapper/311:01:423
13338992623,3cyclictest0-21swapper/211:02:282
13338992621,4cyclictest6696-21diskmemload09:49:262
13338992621,4cyclictest6696-21diskmemload09:49:262
13338992620,5cyclictest32341-21latency_hist12:25:012
13338992619,0cyclictest0-21swapper/211:46:472
1333899261,17cyclictest0-21swapper/212:12:282
1333899260,22cyclictest29725-21ssh11:24:122
1333899260,22cyclictest29381-21ssh10:26:422
13334992620,1cyclictest151rcu_preempt11:06:461
13330992624,1cyclictest13699-21apt-get07:11:450
13341992521,4cyclictest6696-21diskmemload10:56:133
13341992520,4cyclictest21176-21ssh09:51:313
13341992520,4cyclictest0-21swapper/311:48:373
13341992517,7cyclictest23509-21awk10:50:013
1334199250,21cyclictest0-21swapper/311:17:333
1334199250,0cyclictest13770-21apt-get10:41:473
13338992521,3cyclictest0-21swapper/209:34:382
1333899250,25cyclictest0-21swapper/211:59:132
1333899250,24cyclictest0-21swapper/212:25:572
1333899250,24cyclictest0-21swapper/211:11:482
1333899250,24cyclictest0-21swapper/210:37:262
1333899250,20cyclictest0-21swapper/211:52:392
1333899250,1cyclictest0-21swapper/210:32:562
1333899250,1cyclictest0-21swapper/210:32:562
1333899250,1cyclictest0-21swapper/210:21:172
1333499250,24cyclictest6696-21diskmemload11:23:361
1333499250,24cyclictest0-21swapper/110:15:001
1333499250,1cyclictest7610-21ssh11:04:381
1333099253,1cyclictest62550irq/127-eno111:27:540
13330992522,2cyclictest0-21swapper/009:30:450
1333099250,24cyclictest6696-21diskmemload12:22:030
1333099250,24cyclictest6696-21diskmemload12:10:240
1333099250,24cyclictest6696-21diskmemload11:37:320
1333099250,24cyclictest6696-21diskmemload11:31:010
1333099250,24cyclictest6696-21diskmemload09:47:150
1333099250,24cyclictest6696-21diskmemload09:47:150
1333099250,1cyclictest3280-21ssh10:03:370
13341992420,3cyclictest6696-21diskmemload12:35:593
13341992420,3cyclictest6696-21diskmemload09:35:543
13341992419,4cyclictest2244-21ssh10:31:223
13341992419,4cyclictest2244-21ssh10:31:223
1334199240,24cyclictest0-21swapper/312:05:223
1334199240,23cyclictest6696-21diskmemload12:04:193
1334199240,0cyclictest0-21swapper/310:15:553
1334199240,0cyclictest0-21swapper/309:29:563
1334199240,0cyclictest0-21swapper/309:16:003
13338992421,3cyclictest0-21swapper/210:43:192
13338992420,3cyclictest6696-21diskmemload12:17:322
1333899240,23cyclictest6696-21diskmemload11:25:022
1333899240,23cyclictest6696-21diskmemload11:19:202
1333899240,23cyclictest0-21swapper/209:54:312
1333899240,20cyclictest6696-21diskmemload10:12:372
1333899240,1cyclictest19159-21ssh09:20:522
1333899240,0cyclictest0-21swapper/212:05:352
1333899240,0cyclictest0-21swapper/210:15:592
1333899240,0cyclictest0-21swapper/209:35:552
13334992422,1cyclictest0-21swapper/111:37:341
13334992421,2cyclictest21254-21ssh11:46:211
13334992421,2cyclictest13158-21sh09:15:221
1333499240,24cyclictest7436-21sh11:32:561
1333499240,24cyclictest22-21ksoftirqd/112:03:421
1333499240,24cyclictest0-21swapper/110:20:321
1333499240,23cyclictest6131-21ssh10:06:471
1333499240,1cyclictest20108-21diskmemload09:50:031
1333499240,0cyclictest0-21swapper/109:35:511
1333499240,0cyclictest0-21swapper/109:10:371
13330992423,1cyclictest0-21swapper/012:25:400
13330992422,1cyclictest0-21swapper/011:21:530
1333099240,24cyclictest0-21swapper/011:55:400
1333099240,23cyclictest6696-21diskmemload10:49:090
1333099240,23cyclictest0-21swapper/012:15:200
1333099240,1cyclictest0-21swapper/010:17:100
1333099240,0cyclictest6696-21diskmemload10:12:020
1333099240,0cyclictest11516-21ssh10:39:040
1333099240,0cyclictest0-21swapper/009:27:320
1333099240,0cyclictest0-21swapper/009:15:480
13341992323,0cyclictest0-21swapper/311:05:123
13341992322,1cyclictest7235-21diskmemload10:06:523
13341992320,3cyclictest0-21swapper/312:14:383
13341992320,3cyclictest0-21swapper/310:10:053
13341992320,2cyclictest25316-21latency_hist07:35:013
1334199230,23cyclictest6696-21diskmemload11:55:223
1334199230,23cyclictest0-21swapper/311:30:423
1334199230,23cyclictest0-21swapper/310:36:013
1334199230,22cyclictest24341-21grep12:16:563
1334199230,0cyclictest0-21swapper/312:20:503
1334199230,0cyclictest0-21swapper/311:54:413
13338992320,3cyclictest0-21swapper/211:30:372
13338992320,0cyclictest0-21swapper/210:51:312
13338992320,0cyclictest0-21swapper/210:05:362
1333899230,2cyclictest19486-21munin-run08:30:012
1333899230,2cyclictest17087-21apt08:25:012
1333899230,23cyclictest6696-21diskmemload11:09:312
1333899230,23cyclictest0-21swapper/212:37:482
1333899230,23cyclictest0-21swapper/209:57:282
1333899230,22cyclictest29523-21diskmemload10:55:162
1333899230,22cyclictest20501-21cron07:25:012
1333899230,22cyclictest0-21swapper/211:40:102
1333899230,1cyclictest6696-21diskmemload09:41:452
1333899230,1cyclictest10032-21ssh11:36:122
1333899230,0cyclictest0-21swapper/209:15:472
1333899230,0cyclictest0-21swapper/209:13:042
1333899230,0cyclictest0-21swapper/209:01:472
13334992323,0cyclictest6696-21diskmemload09:20:491
13334992323,0cyclictest0-21swapper/112:17:491
13334992323,0cyclictest0-21swapper/111:19:021
13334992323,0cyclictest0-21swapper/110:57:481
13334992323,0cyclictest0-21swapper/110:38:011
13334992323,0cyclictest0-21swapper/109:32:281
13334992321,1cyclictest7456-21cron08:05:001
13334992321,1cyclictest15393-21ssh09:46:111
13334992321,1cyclictest15393-21ssh09:46:111
13334992320,2cyclictest31207-21ssh11:25:551
1333499230,23cyclictest6696-21diskmemload09:58:051
1333499230,23cyclictest0-21swapper/112:35:071
1333499230,23cyclictest0-21swapper/111:56:311
1333499230,23cyclictest0-21swapper/111:50:421
1333499230,23cyclictest0-21swapper/111:12:521
1333499230,23cyclictest0-21swapper/110:52:571
1333499230,23cyclictest0-21swapper/110:01:131
1333499230,22cyclictest32546-21ssh12:25:021
1333499230,22cyclictest31611-21sh12:24:011
1333499230,1cyclictest13830-21/usr/sbin/munin10:41:471
1333499230,0cyclictest0-21swapper/112:30:111
1333499230,0cyclictest0-21swapper/110:46:301
1333499230,0cyclictest0-21swapper/110:30:541
1333499230,0cyclictest0-21swapper/110:30:541
13330992323,0cyclictest6696-21diskmemload10:57:090
13330992323,0cyclictest0-21swapper/009:20:050
13330992322,1cyclictest14194-21rm11:10:460
13330992321,1cyclictest22764-21tail09:51:540
1333099230,2cyclictest9896-21awk09:11:530
1333099230,23cyclictest26618-21sh10:23:560
1333099230,23cyclictest10356-21ssh12:33:340
1333099230,23cyclictest0-21swapper/011:05:130
1333099230,23cyclictest0-21swapper/010:31:560
1333099230,23cyclictest0-21swapper/010:31:560
1333099230,22cyclictest6696-21diskmemload11:43:390
1333099230,22cyclictest6696-21diskmemload09:10:010
1333099230,22cyclictest5017-21ssh12:00:320
1333099230,22cyclictest4325-21perf09:05:010
1333099230,22cyclictest27521-21apt-get08:46:450
1333099230,1cyclictest3729-21sh09:35:240
1333099230,0cyclictest0-21swapper/011:17:160
1333099230,0cyclictest0-21swapper/010:27:530
1333099230,0cyclictest0-21swapper/009:42:340
13341992221,1cyclictest25695-21apt-get07:36:453
13341992220,1cyclictest0-21swapper/310:21:483
13341992218,4cyclictest0-21swapper/309:10:543
1334199220,21cyclictest4708-21apt-get09:06:453
1334199220,21cyclictest0-21swapper/308:31:473
1334199220,1cyclictest24648-21cron08:40:003
1334199220,1cyclictest0-21swapper/309:21:533
1334199220,1cyclictest0-21swapper/308:10:013
13338992220,1cyclictest20907-21apt-get07:26:462
13338992220,1cyclictest0-21swapper/209:25:112
1333899220,21cyclictest7096-21munin-run09:10:012
1333899220,21cyclictest23305-21apt-get07:31:472
1333899220,21cyclictest0-21swapper/207:56:462
1333899220,21cyclictest0-21swapper/207:36:452
1333899220,1cyclictest13699-21apt-get07:11:462
13334992222,0cyclictest6696-21diskmemload11:42:251
13334992222,0cyclictest0-21swapper/109:26:191
13334992220,1cyclictest6701-21ssh09:10:011
1333499220,21cyclictest6696-21diskmemload10:16:001
1333499220,1cyclictest27555-21apt-get10:25:011
1333499220,1cyclictest13635-21ssh09:43:591
1333499220,0cyclictest6696-21diskmemload12:06:511
1333099223,19cyclictest62550irq/127-eno111:45:020
13330992222,0cyclictest6696-21diskmemload10:50:450
13330992222,0cyclictest0-21swapper/009:57:120
13330992221,1cyclictest16374-21kworker/u8:211:00:270
13330992221,1cyclictest10202-21sh12:05:020
13330992220,1cyclictest22915-21perf07:30:010
1333099220,21cyclictest1928-21munin-run09:00:010
1333099220,21cyclictest0-21swapper/011:50:110
1333099220,21cyclictest0-21swapper/007:45:000
1333099220,1cyclictest12204-21rm12:35:450
13341992119,1cyclictest0-21swapper/308:25:013
1334199210,20cyclictest0-21swapper/308:41:463
1334199210,1cyclictest22896-21idleruntime-cro07:30:013
1334199210,1cyclictest18125-21sendmail-msp07:20:013
13338992120,1cyclictest12252-21perf08:15:012
13338992119,1cyclictest21872-21perf08:35:002
13334992120,1cyclictest25074-21apt-get08:41:461
13334992120,1cyclictest0-21swapper/112:10:421
13334992120,0cyclictest602-21apt-get07:51:461
1333499210,20cyclictest0-21swapper/108:56:481
13330992119,1cyclictest27091-21munin-run08:45:000
1333099210,21cyclictest0-21swapper/010:05:310
1333099210,20cyclictest0-21swapper/007:46:490
1333099210,0cyclictest0-21swapper/008:51:480
13341992020,0cyclictest0-21swapper/307:21:463
13341992018,1cyclictest0-21swapper/308:30:013
1334199200,19cyclictest0-21swapper/308:46:453
1334199200,0cyclictest0-21swapper/307:51:463
1334199200,0cyclictest0-21swapper/307:46:493
1334199200,0cyclictest0-21swapper/307:41:453
13338992020,0cyclictest0-21swapper/207:41:462
13338992019,1cyclictest14676-21perf08:20:012
1333899200,19cyclictest0-21swapper/208:36:462
1333899200,0cyclictest0-21swapper/208:46:452
13334992020,0cyclictest29917-21apt-get08:51:481
13334992020,0cyclictest0-21swapper/108:16:461
13330992020,0cyclictest0-21swapper/008:06:470
1333099200,20cyclictest0-21swapper/008:21:470
1333099200,20cyclictest0-21swapper/007:56:460
1333099200,0cyclictest0-21swapper/008:31:470
1333099200,0cyclictest0-21swapper/007:31:470
1333099200,0cyclictest0-21swapper/007:21:460
1333099200,0cyclictest0-21swapper/007:16:460
13341991919,0cyclictest0-21swapper/309:01:473
1334199190,0cyclictest0-21swapper/308:16:473
13338991919,0cyclictest0-21swapper/207:51:462
13338991916,2cyclictest18104-21perf07:20:012
13334991917,1cyclictest17058-21cron08:25:011
13330991919,0cyclictest0-21swapper/007:36:450
13330991915,3cyclictest13-21ksoftirqd/008:40:000
13338991818,0cyclictest0-21swapper/208:51:482
13338991818,0cyclictest0-21swapper/208:41:462
13334991818,0cyclictest2317-21apt-get09:01:471
13334991818,0cyclictest0-21swapper/108:46:451
13334991818,0cyclictest0-21swapper/108:26:461
13334991818,0cyclictest0-21swapper/108:11:471
13334991818,0cyclictest0-21swapper/107:46:491
13334991818,0cyclictest0-21swapper/107:41:461
13334991818,0cyclictest0-21swapper/107:36:451
13334991818,0cyclictest0-21swapper/107:31:471
13334991817,1cyclictest7860-21apt-get08:06:471
13330991817,0cyclictest0-21swapper/007:51:460
1334199170,3cyclictest606-21dbus-daemon08:00:003
1333899170,12cyclictest313-21systemd-journal08:05:402
13334991716,1cyclictest22923-21munin-run07:30:011
13330991716,0cyclictest7467-21apt08:05:000
13330991714,2cyclictest19321-21chrt08:28:260
13341991616,0cyclictest0-21swapper/307:11:463
13341991513,1cyclictest12265-21munin-run08:15:013
13341991513,0cyclictest0-21swapper/308:58:253
13334991515,0cyclictest0-21swapper/107:21:461
13334991515,0cyclictest0-21swapper/107:11:451
1333499150,7cyclictest0-21swapper/108:36:461
1334199140,14cyclictest0-21swapper/308:50:463
1334199140,0cyclictest0-21swapper/308:00:293
13338991414,0cyclictest0-21swapper/208:55:242
13338991414,0cyclictest0-21swapper/207:45:112
1333899140,14cyclictest0-21swapper/208:01:112
13334991414,0cyclictest0-21swapper/108:31:301
1333499140,14cyclictest0-21swapper/107:55:341
13330991414,0cyclictest0-21swapper/008:10:140
1333099140,14cyclictest0-21swapper/008:15:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional