You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-10 - 01:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Wed Jun 10, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2194991230,4rtkit-daemon2193-21rtkit-daemon20:53:542
2194991080,5rtkit-daemon2193-21rtkit-daemon00:19:240
2194991040,5rtkit-daemon2193-21rtkit-daemon20:48:543
268779910024,69cyclictest30030-21telnet22:48:440
2687799994,14cyclictest1227-21runrttasks20:55:080
2687799984,14cyclictest0-21swapper/021:03:530
2687799975,72cyclictest0-21swapper/020:14:110
2687799974,13cyclictest0-21swapper/023:19:070
2688499964,29cyclictest0-21swapper/222:53:572
2688499964,26cyclictest0-21swapper/222:09:172
2687799965,13cyclictest0-21swapper/023:23:500
2687799964,68cyclictest0-21swapper/019:44:000
2687799964,13cyclictest4848-21munin-node21:23:520
26877999612,10cyclictest21236-21ssh22:34:030
26884999511,22cyclictest1227-21runrttasks23:03:152
2687799958,69cyclictest0-21swapper/023:08:510
2687799956,12cyclictest0-21swapper/021:34:080
2687799955,71cyclictest31654-21python21:14:080
2687799955,71cyclictest31654-21python21:14:080
2687799954,12cyclictest0-21swapper/000:03:510
2687799954,12cyclictest0-21swapper/000:03:510
26877999518,53cyclictest0-21swapper/021:19:180
26877999518,53cyclictest0-21swapper/021:19:180
2688499944,29cyclictest0-21swapper/221:58:582
2688499944,29cyclictest0-21swapper/221:58:582
2687799945,14cyclictest0-21swapper/023:08:030
2687799944,75cyclictest0-21swapper/021:38:470
2687799944,68cyclictest0-21swapper/021:47:140
2687799944,14cyclictest0-21swapper/023:13:590
26885999320,67cyclictest5177-21gltestperf19:19:023
2688499935,28cyclictest0-21swapper/222:13:472
2687799936,19cyclictest107550irq/46-eth022:03:500
2687799935,66cyclictest0-21swapper/022:24:110
2687799934,70cyclictest0-21swapper/023:44:350
2687799934,70cyclictest0-21swapper/000:13:310
2687799934,15cyclictest0-21swapper/022:08:530
2687799934,15cyclictest0-21swapper/020:59:170
2687799934,13cyclictest0-21swapper/021:48:540
26884999232,11cyclictest25581-21sed21:53:522
26884999232,11cyclictest25581-21sed21:53:522
2687799925,69cyclictest0-21swapper/021:10:230
2687799925,15cyclictest0-21swapper/023:33:540
2687799925,14cyclictest0-21swapper/023:29:000
2687799924,14cyclictest0-21swapper/022:48:040
2687799923,23cyclictest0-21swapper/023:58:470
26877999220,50cyclictest0-21swapper/020:38:560
2688499915,29cyclictest0-21swapper/221:13:552
2688499915,29cyclictest0-21swapper/221:13:552
2688499915,27cyclictest0-21swapper/221:29:022
26884999119,11cyclictest9972-21rm23:53:532
2687799914,71cyclictest0-21swapper/022:53:490
2687799914,66cyclictest25912-21telnet20:03:500
2687799914,64cyclictest0-21swapper/021:56:070
2687799914,64cyclictest0-21swapper/021:56:070
2687799914,14cyclictest0-21swapper/019:10:140
2687799914,14cyclictest0-21swapper/000:23:500
26877999121,63cyclictest12208-21seq23:57:400
2688599904,12cyclictest0-21swapper/321:34:023
2688599903,64cyclictest0-21swapper/321:00:443
2688499905,27cyclictest0-21swapper/222:35:592
2688499904,29cyclictest0-21swapper/200:08:432
2687799905,15cyclictest0-21swapper/000:13:540
2687799904,80cyclictest0-21swapper/022:31:430
2687799904,13cyclictest0-21swapper/023:49:470
2687799904,13cyclictest0-21swapper/019:14:000
219499900,6rtkit-daemon0-21swapper/222:44:572
2688599893,61cyclictest0-21swapper/322:13:473
26885998924,45cyclictest23734-21df_abs22:38:493
26885998924,45cyclictest23734-21df_abs22:38:493
2688499895,24cyclictest0-21swapper/223:43:322
2688499895,23cyclictest0-21swapper/223:19:042
2688499894,29cyclictest0-21swapper/223:03:492
2688499894,29cyclictest0-21swapper/218:59:032
2688499894,25cyclictest19621-21diskmemload21:09:032
2687799895,68cyclictest0-21swapper/022:41:480
2687799895,68cyclictest0-21swapper/022:41:480
2687799894,63cyclictest0-21swapper/022:58:580
2687799894,62cyclictest0-21swapper/022:13:510
2687799894,14cyclictest0-21swapper/022:19:050
2687799894,14cyclictest0-21swapper/021:58:590
2687799894,14cyclictest0-21swapper/021:58:590
2687799894,14cyclictest0-21swapper/019:49:080
2688599884,68cyclictest0-21swapper/300:13:203
2688599884,12cyclictest0-21swapper/323:41:223
2688599883,65cyclictest0-21swapper/300:03:283
2688499887,26cyclictest0-21swapper/222:48:482
2688499886,38cyclictest0-21swapper/221:44:142
2688499885,28cyclictest0-21swapper/200:15:222
2688499884,29cyclictest0-21swapper/221:19:052
2688499884,29cyclictest0-21swapper/221:19:052
2688499884,25cyclictest0-21swapper/222:25:142
2688499884,25cyclictest0-21swapper/200:21:212
2687799884,14cyclictest0-21swapper/023:43:220
2688599875,64cyclictest0-21swapper/321:28:573
2688499875,29cyclictest0-21swapper/223:31:532
2688499875,27cyclictest0-21swapper/222:29:092
2688499874,27cyclictest0-21swapper/223:53:312
2687799874,64cyclictest5277-21latency_hist20:28:410
2687799874,15cyclictest0-21swapper/021:29:520
26885998624,45cyclictest19621-21diskmemload21:23:583
26885998620,48cyclictest1227-21runrttasks20:04:113
2688499866,28cyclictest0-21swapper/200:26:332
2688499865,27cyclictest0-21swapper/220:09:152
2688499864,23cyclictest5190-21cpuspeed_turbos21:23:512
26884998621,14cyclictest0-21swapper/223:13:522
2688599854,12cyclictest0-21swapper/322:08:373
26885998523,42cyclictest26635-21munin-node21:08:513
26885998515,63cyclictest443-21cat00:28:313
2688499856,29cyclictest0-21swapper/221:49:062
2688499855,28cyclictest0-21swapper/221:03:452
2688499855,28cyclictest0-21swapper/200:03:532
2688499855,28cyclictest0-21swapper/200:03:532
2688499854,28cyclictest0-21swapper/222:23:352
2688499854,28cyclictest0-21swapper/222:04:092
2688499854,28cyclictest0-21swapper/221:36:112
26884998520,14cyclictest0-21swapper/223:37:182
2687799854,35cyclictest0-21swapper/019:31:080
2688599845,11cyclictest0-21swapper/322:33:583
2688599843,14cyclictest0-21swapper/322:50:383
2688499844,27cyclictest22531-21ssh23:23:572
2688499844,24cyclictest19621-21diskmemload23:43:582
2687799845,63cyclictest0-21swapper/020:43:510
2687799843,73cyclictest0-21swapper/020:34:060
2687799843,73cyclictest0-21swapper/020:34:060
2688599834,62cyclictest25815-21grep21:53:553
2688599834,62cyclictest25815-21grep21:53:553
2688599834,12cyclictest0-21swapper/323:46:433
2688599833,72cyclictest922-21ssh21:18:383
2688599833,72cyclictest922-21ssh21:18:383
2688599833,71cyclictest0-21swapper/300:07:563
2688599833,71cyclictest0-21swapper/300:07:563
2688599833,67cyclictest0-21swapper/322:58:563
2688599833,13cyclictest0-21swapper/323:33:533
26885998320,40cyclictest27683-21munin-node22:43:583
2688599832,74cyclictest0-21swapper/322:19:003
26885998312,8cyclictest15158-21kworker/3:221:19:083
26885998312,8cyclictest15158-21kworker/3:221:19:083
2688599824,57cyclictest135622sed22:23:503
2688599823,72cyclictest15608-21awk23:13:543
2688599823,61cyclictest0-21swapper/323:08:453
2688599823,12cyclictest0-21swapper/323:03:543
26885998210,9cyclictest7693-21cat23:49:063
2688499824,26cyclictest0-21swapper/220:30:282
2687799824,57cyclictest0-21swapper/019:03:540
26877998226,47cyclictest0-21swapper/020:19:070
2688599817,9cyclictest21739-21munin-node21:49:063
2688599814,12cyclictest0-21swapper/323:53:593
2688599813,59cyclictest17465-21munin-node20:54:123
26884998135,11cyclictest1822-21strings20:19:062
2687799813,72cyclictest0-21swapper/019:23:550
26877998121,53cyclictest0-21swapper/018:59:020
2688599809,51cyclictest0-21swapper/323:23:583
2688599804,12cyclictest0-21swapper/300:13:443
26885998022,40cyclictest23471-21munin-node19:59:023
26885998015,50cyclictest18105-21ssh21:43:373
26885998012,8cyclictest0-21swapper/322:53:483
2687799804,65cyclictest1084-21lldpd19:39:090
2687799804,14cyclictest0-21swapper/019:53:590
26877998026,45cyclictest0-21swapper/019:33:570
2688599793,13cyclictest0-21swapper/321:05:423
26885997910,9cyclictest107550irq/46-eth022:08:553
2688499795,28cyclictest0-21swapper/220:04:042
26882997934,38cyclictest12501-21gltestperf21:33:571
2688599788,48cyclictest0-21swapper/319:39:093
2688599784,12cyclictest0-21swapper/319:49:183
2688599783,68cyclictest1124-21snmpd19:32:103
2688599783,67cyclictest25404-21fschecks_count23:28:513
26885997818,45cyclictest28511-21munin-node21:59:043
26885997818,45cyclictest28511-21munin-node21:59:043
2688499784,28cyclictest0-21swapper/219:14:082
26884997823,11cyclictest0-21swapper/221:03:002
2687799785,65cyclictest0-21swapper/020:08:590
2687799785,14cyclictest0-21swapper/020:51:150
26885997712,47cyclictest0-21swapper/322:32:313
2688499775,29cyclictest0-21swapper/223:58:392
26884997719,14cyclictest0-21swapper/223:10:502
26882997736,25cyclictest2135-21munin-node22:53:571
26882997734,36cyclictest30000-21rm23:34:091
2687799775,14cyclictest0-21swapper/019:18:540
2688599764,52cyclictest0-21swapper/319:54:133
2688599763,15cyclictest0-21swapper/323:23:013
2688599763,15cyclictest0-21swapper/319:08:433
2688599762,67cyclictest27963-21gltestperf18:59:013
26885997616,53cyclictest27134-21gltestperf00:18:513
26885997612,51cyclictest0-21swapper/321:43:503
26882997634,36cyclictest29138-21ssh22:46:271
26882997631,38cyclictest4479-21munin-node22:58:471
2687799764,64cyclictest0-21swapper/020:29:110
26877997616,50cyclictest26889-21latency_hist18:58:430
2688599759,12cyclictest0-21swapper/320:18:533
2687799755,14cyclictest0-21swapper/020:01:270
2688599743,64cyclictest0-21swapper/320:24:013
2688599743,13cyclictest0-21swapper/320:43:523
2688599743,13cyclictest0-21swapper/320:30:483
2688599743,13cyclictest0-21swapper/319:09:153
2688599743,11cyclictest9625-21grep20:34:123
2688599743,11cyclictest9625-21grep20:34:123
2688599733,34cyclictest0-21swapper/320:13:403
26885997324,43cyclictest2759-21grep19:14:003
26885997317,50cyclictest17114-21gltestperf19:44:003
26882997335,25cyclictest20272-21ssh21:44:181
26882997239,26cyclictest27536-21unixbench-2d20:04:111
26882997234,32cyclictest27615-21ssh21:56:221
26882997234,32cyclictest27615-21ssh21:56:221
26882997234,31cyclictest10497-21runrttasks23:06:531
2688599714,12cyclictest0-21swapper/319:34:003
2688599713,9cyclictest7112-21cpuspeed_turbos19:23:583
2688599713,14cyclictest0-21swapper/320:43:393
2688599703,60cyclictest1124-21snmpd20:15:263
26882997034,25cyclictest26708-21rm23:29:271
26882997030,34cyclictest14979-21ssh00:00:261
26882996932,31cyclictest14444-21rm22:24:021
26882996929,34cyclictest17924-21latency_hist23:18:341
26882996929,12cyclictest28278-21kworker/1:221:18:011
26882996929,12cyclictest28278-21kworker/1:221:18:011
2688599684,12cyclictest0-21swapper/318:58:433
26882996832,31cyclictest19621-21diskmemload21:32:191
26882996829,34cyclictest0-21swapper/100:09:471
26882996826,36cyclictest0-21swapper/121:04:431
26882996726,36cyclictest0-21swapper/121:19:181
26882996726,36cyclictest0-21swapper/121:19:181
26882996723,36cyclictest29209-21ssh21:11:331
26882996630,30cyclictest7203-21ssh21:25:531
26882996628,32cyclictest0-21swapper/119:34:121
26882996627,33cyclictest19621-21diskmemload22:52:271
26882996626,28cyclictest0-21swapper/121:03:111
26882996537,21cyclictest28634-21timerandwakeup18:59:131
26882996529,30cyclictest4697-21ssh23:44:591
26882996528,31cyclictest0-21swapper/121:49:461
26882996527,33cyclictest0-21swapper/123:54:201
26882996525,34cyclictest0-21swapper/122:15:261
26882996521,39cyclictest0-21swapper/121:38:481
219499650,5rtkit-daemon2193-21rtkit-daemon19:09:582
26882996439,19cyclictest3975-21runrttasks19:16:521
26882996433,20cyclictest18932-21ssh22:31:131
26882996433,16cyclictest26080-21chrt22:42:361
26882996433,16cyclictest26080-21chrt22:42:361
26882996431,28cyclictest12001-21rm22:20:341
26882996431,21cyclictest0-21swapper/123:40:201
26882996425,33cyclictest0-21swapper/100:21:311
26882996424,14cyclictest0-21swapper/119:49:021
252762649,44sleep20-21swapper/218:54:002
26882996340,17cyclictest32668-21runrttasks19:09:031
26882996333,16cyclictest107550irq/46-eth022:00:151
26882996333,16cyclictest107550irq/46-eth022:00:151
26882996329,29cyclictest20504-21sh23:21:251
26882996326,17cyclictest0-21swapper/122:10:171
26882996244,12cyclictest1227-21runrttasks20:36:451
26882996244,12cyclictest1227-21runrttasks20:36:451
26882996229,15cyclictest0-21swapper/122:06:571
26882996225,31cyclictest0-21swapper/123:11:361
26882996142,13cyclictest1227-21runrttasks23:49:591
26882996138,17cyclictest31401-21unixbench_multi00:24:021
26882996138,17cyclictest14822-21runrttasks19:39:011
26882996138,17cyclictest1227-21runrttasks20:13:321
26882996137,18cyclictest22008-21hwlatdetect19:54:001
26882996118,38cyclictest0-21swapper/119:59:361
26882996040,14cyclictest22908-21switchtime23:24:041
26882996037,16cyclictest23027-21aten_r1power_vo00:13:441
26882996035,19cyclictest14548-21runrttasks20:45:081
26882996022,33cyclictest0-21swapper/120:30:281
26882996020,34cyclictest0-21swapper/119:44:021
2688499594,38cyclictest0-21swapper/219:54:152
26882995941,13cyclictest31247-21unixbench_singl19:04:161
26882995941,13cyclictest30979-21cpuspeed_turbos20:13:541
26882995940,13cyclictest9780-21sort19:29:001
26882995940,12cyclictest20207-21cpuspeed_turbos22:33:491
26882995938,15cyclictest8882-21runrttasks19:28:331
26882995935,18cyclictest6261-21runrttasks19:20:271
26882995935,18cyclictest19548-21runrttasks20:57:521
26882995932,15cyclictest17084-21basename00:03:531
26882995932,15cyclictest17084-21basename00:03:531
2688499584,27cyclictest0-21swapper/219:48:522
26882995841,11cyclictest1227-21runrttasks20:27:581
26882995840,12cyclictest11133-21gltestperf20:38:591
26882995838,14cyclictest2244-21switchtime20:19:121
26882995837,15cyclictest15726-21fschecks_count20:48:571
2688499564,26cyclictest0-21swapper/221:42:312
26884995611,24cyclictest0-21swapper/220:38:392
26884995611,24cyclictest0-21swapper/220:38:392
2688499554,30cyclictest0-21swapper/220:49:082
26884995521,14cyclictest0-21swapper/219:04:032
2688499545,29cyclictest0-21swapper/220:24:002
2688499544,30cyclictest0-21swapper/220:44:142
2688499535,30cyclictest0-21swapper/222:38:492
2688499535,30cyclictest0-21swapper/222:38:492
2688499524,28cyclictest0-21swapper/220:38:572
26884995219,13cyclictest0-21swapper/219:20:162
26882995233,14cyclictest26858-21latency_hist18:58:441
219499520,5rtkit-daemon2193-21rtkit-daemon20:14:032
2688499515,28cyclictest0-21swapper/219:38:542
2688499512,35cyclictest0-21swapper/219:28:582
2688499504,29cyclictest0-21swapper/219:48:412
2688499504,28cyclictest0-21swapper/219:34:152
26884995017,12cyclictest0-21swapper/219:58:522
26884995016,15cyclictest0-21swapper/219:23:562
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional