You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-17 - 10:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot5s.osadl.org (updated Sun May 17, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1368399280,0cyclictest0-21swapper/122:04:591
13683992720,3cyclictest0-21swapper/100:22:161
1368399270,22cyclictest14757-21cron21:45:011
1368399270,0cyclictest7327-21diskmemload21:47:571
1368399270,0cyclictest0-21swapper/121:15:531
13690992625,1cyclictest0-21swapper/322:43:493
13683992622,4cyclictest7327-21diskmemload23:17:161
1368399260,25cyclictest0-21swapper/121:50:021
1368399260,21cyclictest7327-21diskmemload21:22:251
1368399260,1cyclictest0-21swapper/123:40:401
1368399260,0cyclictest0-21swapper/122:11:081
1368399260,0cyclictest0-21swapper/100:14:171
13680992621,4cyclictest7327-21diskmemload22:58:530
13680992621,4cyclictest7327-21diskmemload00:31:100
13680992620,1cyclictest0-21swapper/023:09:510
1368099260,25cyclictest27236-21smartctl23:22:220
1368099260,21cyclictest9769-21ssh21:40:370
1368099260,1cyclictest10529-21ssh00:03:430
13690992524,0cyclictest2841-21users22:02:293
1369099250,25cyclictest0-21swapper/300:38:163
1369099250,24cyclictest0-21swapper/322:47:243
1368899250,24cyclictest19781-21rm23:15:452
1368899250,24cyclictest0-21swapper/221:30:582
13683992521,3cyclictest0-21swapper/123:54:181
1368399250,24cyclictest0-21swapper/123:48:201
1368399250,24cyclictest0-21swapper/123:28:241
1368399250,21cyclictest0-21swapper/123:23:521
1368399250,21cyclictest0-21swapper/122:57:481
1368399250,21cyclictest0-21swapper/100:25:061
1368399250,0cyclictest7327-21diskmemload22:34:381
1368399250,0cyclictest7327-21diskmemload21:25:141
13680992522,3cyclictest0-21swapper/000:26:340
13680992520,1cyclictest8507-21ssh21:39:130
13680992520,1cyclictest28943-21taskset00:20:350
13680992519,5cyclictest0-21swapper/022:05:030
13680992518,2cyclictest19160-21ssh21:48:240
1368099250,24cyclictest8852-21fschecks_time22:37:220
1368099250,24cyclictest7327-21diskmemload23:58:190
1368099250,24cyclictest0-21swapper/022:42:160
1368099250,24cyclictest0-21swapper/021:19:220
1368099250,21cyclictest7327-21diskmemload22:45:200
1368099250,21cyclictest0-21swapper/022:14:430
1368099250,1cyclictest31902-21ssh22:00:150
1368099250,1cyclictest18595-21ssh23:14:350
13690992423,1cyclictest7327-21diskmemload00:00:153
13690992423,1cyclictest0-21swapper/323:40:183
13690992422,2cyclictest0-21swapper/322:37:243
13690992422,1cyclictest24563-21ssh21:53:093
13690992421,2cyclictest7327-21diskmemload21:47:553
1369099241,22cyclictest9386-21ssh23:06:543
1369099240,23cyclictest3698-21apt-get21:35:023
13688992423,1cyclictest23422-21ssh21:23:462
13688992423,1cyclictest0-21swapper/222:32:192
13688992420,0cyclictest0-21swapper/223:11:232
13688992420,0cyclictest0-21swapper/200:10:372
1368899241,22cyclictest10899-21idleruntime-cro20:10:012
1368899240,23cyclictest7327-21diskmemload21:55:282
1368899240,23cyclictest6039-21sh23:02:422
1368899240,1cyclictest622-21gdbus22:25:002
13683992422,2cyclictest0-21swapper/122:49:081
13683992422,2cyclictest0-21swapper/100:06:431
13683992420,3cyclictest7327-21diskmemload00:03:401
13683992420,3cyclictest0-21swapper/123:08:101
13683992420,3cyclictest0-21swapper/122:40:421
1368399240,24cyclictest0-21swapper/123:56:121
1368399240,24cyclictest0-21swapper/100:38:161
1368399240,23cyclictest28268-21kworker/u8:021:38:571
1368399240,23cyclictest0-21swapper/122:37:331
1368399240,23cyclictest0-21swapper/122:17:001
1368399240,23cyclictest0-21swapper/121:58:391
1368399240,21cyclictest0-21swapper/121:10:031
1368399240,0cyclictest0-21swapper/123:10:191
1368399240,0cyclictest0-21swapper/122:25:141
13680992424,0cyclictest0-21swapper/023:38:350
13680992423,1cyclictest0-21swapper/021:26:470
13680992420,0cyclictest0-21swapper/000:37:510
1368099240,2cyclictest16764-21sh22:15:130
1368099240,23cyclictest7327-21diskmemload00:08:280
1368099240,23cyclictest30912-21ssh23:25:450
1368099240,20cyclictest0-21swapper/021:20:370
1368099240,20cyclictest0-21swapper/000:15:040
1368099240,1cyclictest7327-21diskmemload21:54:160
1368099240,0cyclictest0-21swapper/023:30:270
1368099240,0cyclictest0-21swapper/023:16:430
1368099240,0cyclictest0-21swapper/022:28:120
1368099240,0cyclictest0-21swapper/022:22:230
13690992323,0cyclictest0-21swapper/323:20:023
13690992323,0cyclictest0-21swapper/321:58:143
13690992323,0cyclictest0-21swapper/320:27:203
13690992323,0cyclictest0-21swapper/300:25:213
13690992322,1cyclictest0-21swapper/323:31:093
13690992322,1cyclictest0-21swapper/322:26:313
13690992322,1cyclictest0-21swapper/322:07:193
13690992322,1cyclictest0-21swapper/319:17:193
1369099232,20cyclictest3810-21ssh23:57:513
13690992322,0cyclictest0-21swapper/321:16:413
13690992321,2cyclictest22679-21sh22:20:373
13690992321,1cyclictest7327-21diskmemload23:19:073
1369099231,22cyclictest0-21swapper/300:12:353
1369099231,21cyclictest21161-21ssh23:45:333
1369099231,1cyclictest11571-21ssh00:33:223
1369099230,22cyclictest30986-21rm21:31:063
1369099230,1cyclictest0-21swapper/323:40:013
1369099230,0cyclictest0-21swapper/322:34:073
1369099230,0cyclictest0-21swapper/322:10:013
1369099230,0cyclictest0-21swapper/300:17:163
13688992323,0cyclictest0-21swapper/223:55:582
13688992323,0cyclictest0-21swapper/221:40:342
13688992322,1cyclictest24522-21ssh22:51:292
13688992321,1cyclictest18420-21sh22:45:542
13688992321,0cyclictest0-21swapper/222:28:142
1368899230,23cyclictest0-21swapper/222:37:452
1368899230,23cyclictest0-21swapper/222:12:442
1368899230,23cyclictest0-21swapper/221:18:522
1368899230,23cyclictest0-21swapper/200:20:142
1368899230,22cyclictest4778-21apt-get22:05:022
1368899230,22cyclictest25687-21ssh23:21:062
1368899230,22cyclictest16953-21ssh22:15:272
1368899230,22cyclictest0-21swapper/223:30:392
1368899230,0cyclictest0-21swapper/223:45:352
1368899230,0cyclictest0-21swapper/223:38:352
1368899230,0cyclictest0-21swapper/222:41:012
1368899230,0cyclictest0-21swapper/221:53:262
1368899230,0cyclictest0-21swapper/221:10:592
1368899230,0cyclictest0-21swapper/219:20:022
1368899230,0cyclictest0-21swapper/200:36:002
1368899230,0cyclictest0-21swapper/200:17:152
1368899230,0cyclictest0-21swapper/200:06:202
13683992323,0cyclictest0-21swapper/100:30:591
13683992323,0cyclictest0-21swapper/100:16:341
13683992321,1cyclictest0-21swapper/123:37:251
1368399230,23cyclictest0-21swapper/122:21:201
1368399230,22cyclictest7327-21diskmemload22:05:051
1368399230,22cyclictest0-21swapper/121:32:241
1368399230,14cyclictest18538-21apt-get20:27:201
1368399230,0cyclictest0-21swapper/123:31:481
1368399230,0cyclictest0-21swapper/123:03:411
13680992323,0cyclictest0-21swapper/021:59:040
13680992321,1cyclictest274272sleep023:50:520
13680992320,2cyclictest3039-21sh23:00:560
13680992320,0cyclictest7327-21diskmemload00:11:170
1368099230,23cyclictest0-21swapper/022:30:290
1368099230,22cyclictest8228-21rm21:10:510
1368099230,0cyclictest0-21swapper/022:51:230
13690992222,0cyclictest0-21swapper/321:07:203
13690992221,1cyclictest30022-21ssh22:56:113
13690992221,1cyclictest0-21swapper/323:25:243
13690992221,1cyclictest0-21swapper/319:22:203
13690992220,1cyclictest12440-21ssh00:05:593
1369099221,21cyclictest0-21swapper/321:42:183
1369099221,1cyclictest7327-21diskmemload00:22:023
1369099220,22cyclictest0-21swapper/323:00:333
1369099220,22cyclictest0-21swapper/322:50:513
1369099220,21cyclictest7327-21diskmemload21:11:493
1369099220,21cyclictest4943-21cron21:05:013
1369099220,21cyclictest24542-21rm21:25:013
1369099220,21cyclictest14769-21ssh23:11:413
1369099220,21cyclictest0-21swapper/320:37:193
1369099220,21cyclictest0-21swapper/320:32:183
13688992222,0cyclictest0-21swapper/221:45:402
13688992220,1cyclictest32268-21ssh22:00:422
13688992220,1cyclictest0-21swapper/223:07:462
13688992220,1cyclictest0-21swapper/221:27:272
1368899220,22cyclictest7327-21diskmemload22:55:322
1368899220,21cyclictest1779-21sh00:25:112
1368899220,21cyclictest14080-21apt-get19:12:202
1368899220,21cyclictest0-21swapper/223:40:022
1368899220,21cyclictest0-21swapper/200:31:102
1368899220,1cyclictest4483-21ssh21:36:042
1368899220,1cyclictest13284-21apt20:15:012
1368899220,1cyclictest0-21swapper/200:00:112
1368899220,0cyclictest7327-21diskmemload23:25:412
13683992220,1cyclictest0-21swapper/122:50:191
1368399220,21cyclictest2994-21apt-get21:02:201
1368399220,1cyclictest524-21apt-get20:57:201
13680992220,1cyclictest5678-21ls20:00:000
13680992220,1cyclictest19077-21apt-get19:20:020
1368099220,21cyclictest7327-21diskmemload23:40:220
1368099220,21cyclictest7327-21diskmemload21:30:220
1368099220,21cyclictest21070-21rm23:45:260
1368099220,21cyclictest20931-21apt-get20:32:180
1368099220,21cyclictest0-21swapper/020:57:200
13690992121,0cyclictest7327-21diskmemload22:15:033
13690992121,0cyclictest0-21swapper/321:20:443
13690992119,1cyclictest18306-21latency_hist20:25:013
1369099210,21cyclictest7327-21diskmemload23:50:263
1368899210,20cyclictest25800-21apt-get20:42:192
1368899210,20cyclictest0-21swapper/220:32:182
1368899210,1cyclictest7327-21diskmemload23:50:022
1368899210,0cyclictest28944-21apt-get19:42:182
13683992121,0cyclictest1311-21apt-get19:52:191
13683992120,1cyclictest0-21swapper/119:17:191
1368399210,3cyclictest30158-21perf20:50:001
1368399210,1cyclictest5387-21apt-get21:07:201
13680992121,0cyclictest0-21swapper/020:02:190
13680992119,1cyclictest0-21swapper/020:40:000
1368099210,0cyclictest0-21swapper/020:52:210
13690992020,0cyclictest21698-21apt-get19:27:323
13690992020,0cyclictest0-21swapper/320:57:203
13690992020,0cyclictest0-21swapper/320:05:023
13690992020,0cyclictest0-21swapper/319:47:193
13690992020,0cyclictest0-21swapper/319:12:203
13690992019,0cyclictest0-21swapper/320:17:193
1369099200,19cyclictest28494-21ls19:40:013
1369099200,0cyclictest0-21swapper/320:47:183
1368899200,0cyclictest0-21swapper/219:37:192
13683992020,0cyclictest6138-21apt-get20:02:191
13683992020,0cyclictest0-21swapper/120:32:181
13683992019,1cyclictest0-21swapper/120:05:021
1368399200,0cyclictest0-21swapper/120:42:191
13680992020,0cyclictest26529-21apt-get19:37:190
13680992020,0cyclictest0-21swapper/020:17:190
13680992019,1cyclictest0-21swapper/020:47:180
13680992019,0cyclictest0-21swapper/019:42:180
13680992018,1cyclictest850-21cron19:50:000
13680992018,1cyclictest3303-21perf19:55:000
13680992018,1cyclictest16056-21munin-run19:15:000
1368099200,20cyclictest0-21swapper/021:02:200
13690991917,1cyclictest0-21swapper/320:02:233
13688991919,0cyclictest0-21swapper/220:22:182
13688991919,0cyclictest0-21swapper/220:02:202
13688991919,0cyclictest0-21swapper/219:47:192
13688991919,0cyclictest0-21swapper/219:17:182
13683991919,0cyclictest30590-21apt-get20:52:201
13683991919,0cyclictest0-21swapper/119:37:191
13683991919,0cyclictest0-21swapper/119:32:191
13683991918,1cyclictest16143-21apt-get20:22:191
1368399190,1cyclictest313-21systemd-journal19:12:021
13680991919,0cyclictest0-21swapper/020:27:200
13680991918,1cyclictest0-21swapper/020:45:000
13680991918,0cyclictest0-21swapper/019:32:190
13690991818,0cyclictest0-21swapper/320:52:203
13690991818,0cyclictest0-21swapper/320:12:183
13690991817,1cyclictest0-21swapper/319:57:183
13688991818,0cyclictest24133-21apt-get19:32:192
13688991818,0cyclictest0-21swapper/221:02:202
13688991818,0cyclictest0-21swapper/220:57:202
13683991817,0cyclictest18441-21apt-get19:20:021
13680991818,0cyclictest0-21swapper/019:27:320
13680991817,0cyclictest8925-21apt-get20:07:170
13690991717,0cyclictest1807-21tune2fs19:52:213
13690991715,1cyclictest0-21swapper/320:45:003
13688991717,0cyclictest0-21swapper/220:27:202
13688991717,0cyclictest0-21swapper/219:52:182
13688991716,0cyclictest0-21swapper/219:27:322
1368899170,17cyclictest0-21swapper/221:07:202
13683991717,0cyclictest0-21swapper/120:37:191
13680991716,1cyclictest0-21swapper/020:25:010
13690991616,0cyclictest0-21swapper/319:42:183
13690991615,1cyclictest26149-21grep19:35:013
13688991616,0cyclictest32565-21awk20:55:002
13688991614,1cyclictest30141-21awk20:50:002
1368899160,1cyclictest0-21swapper/220:37:192
13683991612,3cyclictest0-21swapper/120:17:191
13688991514,1cyclictest3644-21taskset19:56:462
13683991514,1cyclictest0-21swapper/119:47:191
1368399150,15cyclictest0-21swapper/119:55:261
1368099150,11cyclictest1824-21sendmail-mta21:07:570
1368399140,0cyclictest0-21swapper/120:10:071
13680991414,0cyclictest0-21swapper/020:10:150
1368099140,0cyclictest0-21swapper/019:15:280
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional