You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-20 - 12:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5s.osadl.org (updated Mon Jul 20, 2026 00:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
770599290,0cyclictest0-21swapper/321:22:383
770599280,27cyclictest0-21swapper/323:59:163
7705992720,6cyclictest19034-21apt-get23:52:363
770599270,21cyclictest21889-21ntp_states21:57:433
770599270,0cyclictest0-21swapper/322:18:483
7705992623,3cyclictest0-21swapper/322:36:573
7705992620,5cyclictest26284-21ssh22:31:363
770599260,25cyclictest19680-21ssh22:25:063
770599260,21cyclictest0-21swapper/321:26:563
7705992520,4cyclictest945-21diskmemload22:46:383
770599250,25cyclictest0-21swapper/321:53:503
770599250,24cyclictest7830-21diskmemload22:14:203
770599250,0cyclictest945-21diskmemload00:33:083
770599250,0cyclictest0-21swapper/323:32:453
770099250,25cyclictest945-21diskmemload23:50:272
7694992523,1cyclictest606-21dbus-daemon20:05:001
769499251,23cyclictest606-21dbus-daemon22:20:001
769499250,24cyclictest0-21swapper/123:12:551
769499250,24cyclictest0-21swapper/123:04:431
769499250,24cyclictest0-21swapper/122:03:261
769499250,24cyclictest0-21swapper/100:20:311
7690992525,0cyclictest0-21swapper/021:20:240
7690992523,2cyclictest0-21swapper/021:30:090
7690992523,1cyclictest0-21swapper/023:55:280
7690992523,1cyclictest0-21swapper/000:31:410
769099250,2cyclictest20638-21munin-run22:55:000
769099250,25cyclictest0-21swapper/021:13:550
769099250,24cyclictest945-21diskmemload22:48:490
7705992424,0cyclictest0-21swapper/300:15:583
7705992421,2cyclictest26872-21latency_hist19:50:003
7705992420,3cyclictest945-21diskmemload22:42:113
7705992419,4cyclictest19234-21ssh22:53:103
7705992419,4cyclictest0-21swapper/300:35:523
770599240,24cyclictest0-21swapper/322:21:373
770599240,23cyclictest0-21swapper/300:08:283
770599240,20cyclictest0-21swapper/321:46:093
770599240,1cyclictest1940-21sh21:10:563
770599240,0cyclictest945-21diskmemload22:00:123
770599240,0cyclictest30026-21ssh22:05:073
770599240,0cyclictest0-21swapper/321:38:493
770599240,0cyclictest0-21swapper/300:00:273
7700992422,1cyclictest0-21swapper/222:17:372
770099240,23cyclictest0-21swapper/221:23:312
769499240,23cyclictest945-21diskmemload21:45:341
769499240,23cyclictest1983-21sh23:36:541
769499240,23cyclictest0-21swapper/123:24:581
769499240,23cyclictest0-21swapper/122:07:451
769499240,23cyclictest0-21swapper/121:57:001
769499240,1cyclictest0-21swapper/123:17:111
769499240,0cyclictest0-21swapper/121:53:591
769499240,0cyclictest0-21swapper/121:23:441
7690992424,0cyclictest0-21swapper/021:40:250
7690992422,2cyclictest0-21swapper/023:51:120
769099242,1cyclictest22459-21sh00:23:390
769099240,24cyclictest0-21swapper/023:28:250
769099240,24cyclictest0-21swapper/021:25:280
769099240,23cyclictest945-21diskmemload22:25:110
769099240,23cyclictest12176-21sh23:17:060
769099240,23cyclictest0-21swapper/023:36:060
769099240,0cyclictest0-21swapper/022:42:100
769099240,0cyclictest0-21swapper/022:07:370
7705992323,0cyclictest945-21diskmemload00:12:463
7705992321,1cyclictest0-21swapper/321:31:033
7705992319,4cyclictest0-21swapper/320:07:413
7705992319,3cyclictest945-21diskmemload23:47:493
770599230,2cyclictest24049-21cat23:27:393
770599230,23cyclictest0-21swapper/323:35:483
770599230,23cyclictest0-21swapper/323:10:363
770599230,23cyclictest0-21swapper/323:09:533
770599230,23cyclictest0-21swapper/321:15:523
770599230,22cyclictest21307-21ssh22:55:443
770599230,0cyclictest945-21diskmemload23:20:223
770599230,0cyclictest0-21swapper/300:23:273
7700992323,0cyclictest945-21diskmemload23:00:012
7700992323,0cyclictest0-21swapper/223:44:202
7700992323,0cyclictest0-21swapper/223:31:292
7700992319,1cyclictest945-21diskmemload21:56:232
770099230,23cyclictest0-21swapper/222:48:022
770099230,23cyclictest0-21swapper/221:40:002
770099230,22cyclictest945-21diskmemload22:20:292
770099230,22cyclictest6993-21ssh21:15:042
770099230,22cyclictest32270-21sh22:37:112
770099230,22cyclictest3203-21ssh21:41:182
770099230,22cyclictest24208-21sh00:25:572
770099230,22cyclictest12487-21munin-run19:20:012
770099230,0cyclictest0-21swapper/222:11:412
770099230,0cyclictest0-21swapper/222:09:062
770099230,0cyclictest0-21swapper/221:48:442
770099230,0cyclictest0-21swapper/221:33:142
7694992323,0cyclictest0-21swapper/122:32:551
7694992323,0cyclictest0-21swapper/122:24:061
7694992323,0cyclictest0-21swapper/100:38:231
7694992323,0cyclictest0-21swapper/100:16:041
7694992322,1cyclictest0-21swapper/123:55:011
7694992321,1cyclictest0-21swapper/123:31:591
7694992321,1cyclictest0-21swapper/100:07:531
7694992320,2cyclictest7064-21ptp4l22:42:441
769499230,23cyclictest0-21swapper/123:50:341
769499230,23cyclictest0-21swapper/121:18:131
769499230,22cyclictest980-21sh00:32:581
769499230,22cyclictest945-21diskmemload23:05:301
769499230,22cyclictest4826-21apt-get22:12:361
769499230,22cyclictest0-21swapper/123:41:461
769499230,22cyclictest0-21swapper/123:00:001
769499230,22cyclictest0-21swapper/122:26:171
769499230,1cyclictest0-21swapper/100:00:431
769499230,0cyclictest0-21swapper/122:50:151
7690992323,0cyclictest945-21diskmemload00:16:490
7690992323,0cyclictest0-21swapper/022:31:270
7690992323,0cyclictest0-21swapper/021:59:240
7690992323,0cyclictest0-21swapper/021:15:260
7690992323,0cyclictest0-21swapper/000:39:520
7690992323,0cyclictest0-21swapper/000:02:030
7690992321,1cyclictest0-21swapper/000:12:370
769099231,1cyclictest0-21swapper/019:32:380
769099230,23cyclictest0-21swapper/023:02:490
769099230,22cyclictest5598-21diskmemload23:10:370
769099230,22cyclictest13912-21ssh22:20:000
769099230,22cyclictest0-21swapper/023:30:090
769099230,22cyclictest0-21swapper/022:22:410
769099230,1cyclictest0-21swapper/019:40:010
769099230,0cyclictest945-21diskmemload21:45:290
769099230,0cyclictest0-21swapper/022:13:480
7705992221,1cyclictest6104-21ssh21:42:573
7705992219,3cyclictest0-21swapper/323:40:203
770599220,2cyclictest27409-21taskset23:01:243
770599220,22cyclictest0-21swapper/300:29:213
770599220,21cyclictest0-21swapper/319:57:383
770599220,1cyclictest15765-21ssh23:19:383
7700992222,0cyclictest945-21diskmemload21:25:142
7700992222,0cyclictest0-21swapper/223:47:092
7700992222,0cyclictest0-21swapper/222:25:332
7700992222,0cyclictest0-21swapper/200:37:352
7700992222,0cyclictest0-21swapper/200:21:062
7700992222,0cyclictest0-21swapper/200:11:052
7700992217,4cyclictest0-21swapper/222:40:212
770099220,22cyclictest945-21diskmemload22:04:582
770099220,21cyclictest25271-21ssh22:30:082
770099220,21cyclictest22331-21sh22:57:022
770099220,21cyclictest11382-21ssh23:15:542
770099220,21cyclictest0-21swapper/223:20:382
770099220,21cyclictest0-21swapper/222:50:022
770099220,21cyclictest0-21swapper/221:50:352
770099220,21cyclictest0-21swapper/220:42:362
770099220,1cyclictest6557-21rm00:09:432
770099220,1cyclictest3982-21ssh23:08:452
770099220,1cyclictest31587-21ssh00:02:472
770099220,1cyclictest17729-21apt-get19:32:382
770099220,0cyclictest945-21diskmemload23:36:272
7694992221,0cyclictest0-21swapper/120:45:021
7694992221,0cyclictest0-21swapper/120:22:361
7694992220,1cyclictest0-21swapper/121:25:261
769499220,22cyclictest4102-21apt-get21:42:361
769499220,22cyclictest0-21swapper/121:35:081
769499220,21cyclictest4575-21apt-get20:12:361
769499220,21cyclictest29282-21perf19:55:001
769499220,21cyclictest0-21swapper/123:45:031
769499220,21cyclictest0-21swapper/122:45:321
769499220,21cyclictest0-21swapper/121:30:191
769499220,21cyclictest0-21swapper/121:10:161
769499220,21cyclictest0-21swapper/100:10:241
769499220,0cyclictest0-21swapper/123:26:191
769499220,0cyclictest0-21swapper/121:02:391
7690992222,0cyclictest0-21swapper/023:41:280
7690992220,1cyclictest0-21swapper/023:06:090
7690992220,1cyclictest0-21swapper/022:37:420
769099220,2cyclictest6530-21perf20:15:010
769099220,21cyclictest945-21diskmemload00:05:020
769099220,21cyclictest26073-21idleruntime00:27:380
769099220,21cyclictest0-21swapper/022:55:100
769099220,21cyclictest0-21swapper/022:00:210
769099220,21cyclictest0-21swapper/020:52:360
769099220,21cyclictest0-21swapper/020:02:350
769099220,1cyclictest62550irq/127-eno123:48:150
769099220,1cyclictest0-21swapper/023:24:450
769099220,1cyclictest0-21swapper/021:50:130
7705992119,1cyclictest29276-21grep19:55:003
770599210,0cyclictest0-21swapper/320:35:003
770599210,0cyclictest0-21swapper/319:12:363
7700992121,0cyclictest945-21diskmemload23:25:202
7700992119,1cyclictest14880-21perf19:25:012
770099210,21cyclictest945-21diskmemload00:16:202
770099210,21cyclictest0-21swapper/223:55:142
770099210,1cyclictest5676-21ssh23:10:432
770099210,1cyclictest24492-21idleruntime-cro19:45:002
7694992121,0cyclictest0-21swapper/119:27:361
769499210,21cyclictest0-21swapper/120:27:361
769499210,20cyclictest0-21swapper/121:07:371
769499210,20cyclictest0-21swapper/120:42:351
769499210,20cyclictest0-21swapper/119:47:341
769499210,0cyclictest0-21swapper/119:57:381
7690992121,0cyclictest0-21swapper/019:52:360
7690992119,1cyclictest0-21swapper/021:02:390
7705992020,0cyclictest21787-21apt-get20:47:343
770599200,20cyclictest0-21swapper/320:42:363
770599200,20cyclictest0-21swapper/320:02:353
770599200,0cyclictest22542-21apt-get19:42:373
7700992020,0cyclictest0-21swapper/219:57:382
7700992020,0cyclictest0-21swapper/219:12:362
770099200,0cyclictest24189-21apt-get20:52:362
7694992020,0cyclictest0-21swapper/120:52:371
7694992020,0cyclictest0-21swapper/119:37:371
769499200,0cyclictest0-21swapper/119:17:371
7690992020,0cyclictest0-21swapper/020:47:340
7690992020,0cyclictest0-21swapper/020:07:420
7690992019,1cyclictest62550irq/127-eno119:12:360
7700991919,0cyclictest32197-21apt-get20:02:352
7700991919,0cyclictest31449-21apt-get21:07:372
7700991919,0cyclictest27332-21apt-get19:52:362
7700991918,1cyclictest20948-21apt-get20:45:022
7694991919,0cyclictest12938-21apt-get19:22:371
7694991919,0cyclictest0-21swapper/120:17:361
7694991919,0cyclictest0-21swapper/119:42:371
7690991919,0cyclictest15330-21apt-get19:27:370
7690991919,0cyclictest0-21swapper/020:22:360
7705991818,0cyclictest0-21swapper/319:17:373
7700991818,0cyclictest14187-21apt-get20:32:372
7700991818,0cyclictest0-21swapper/220:57:372
7694991818,0cyclictest0-21swapper/120:07:421
7694991818,0cyclictest0-21swapper/119:12:361
7690991816,1cyclictest24486-21basename19:45:000
7690991816,1cyclictest12467-21turbostat19:20:000
7705991716,1cyclictest17276-21apt19:30:013
7694991717,0cyclictest0-21swapper/120:57:371
7694991717,0cyclictest0-21swapper/120:32:371
7690991717,0cyclictest0-21swapper/020:57:370
7690991717,0cyclictest0-21swapper/020:27:360
7690991715,1cyclictest8892-21cron20:20:010
7705991616,0cyclictest0-21swapper/320:52:373
770599160,1cyclictest0-21swapper/320:12:423
770599160,15cyclictest30760-21head21:02:493
7700991616,0cyclictest0-21swapper/220:17:362
7700991616,0cyclictest0-21swapper/220:07:412
7700991614,1cyclictest606-21dbus-daemon19:40:012
7694991616,0cyclictest0-21swapper/119:32:381
7690991616,0cyclictest0-21swapper/020:32:370
7690991616,0cyclictest0-21swapper/019:57:380
7690991614,1cyclictest0-21swapper/019:47:420
7705991515,0cyclictest0-21swapper/319:37:383
7705991515,0cyclictest0-21swapper/319:32:383
7705991514,1cyclictest0-21swapper/321:08:583
7705991513,2cyclictest0-21swapper/319:22:533
770599150,15cyclictest0-21swapper/320:15:093
770099150,1cyclictest0-21swapper/221:05:012
770099150,14cyclictest0-21swapper/219:47:382
770599140,4cyclictest0-21swapper/320:37:363
770599140,14cyclictest0-21swapper/320:58:363
770599140,14cyclictest0-21swapper/320:20:283
770599140,0cyclictest0-21swapper/320:26:353
770099140,14cyclictest0-21swapper/220:26:132
770099140,14cyclictest0-21swapper/220:21:482
770099140,14cyclictest0-21swapper/220:10:462
770099140,14cyclictest0-21swapper/219:27:042
770099140,0cyclictest0-21swapper/220:35:582
769099140,14cyclictest0-21swapper/021:05:030
769099140,0cyclictest0-21swapper/020:40:560
769099140,0cyclictest0-21swapper/019:20:170
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional