You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-22 - 14:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Mon Jun 22, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1057299280,27cyclictest4179-21diskmemload22:23:263
1057299280,24cyclictest4179-21diskmemload22:31:123
1057199280,27cyclictest0-21swapper/220:55:012
1057299270,26cyclictest0-21swapper/321:45:013
1057199270,26cyclictest0-21swapper/223:18:492
1057199270,26cyclictest0-21swapper/221:49:392
1057199270,24cyclictest0-21swapper/222:38:112
1057199270,1cyclictest75-21kswapd023:55:022
1057199270,1cyclictest1800-21cron21:05:012
1057199270,0cyclictest4179-21diskmemload22:28:022
1057199270,0cyclictest0-21swapper/220:20:182
10564992722,4cyclictest9204-21turbostat.cron21:15:000
1057299260,22cyclictest29642-21users00:05:313
1057299260,21cyclictest0-21swapper/322:45:283
10571992622,4cyclictest0-21swapper/221:25:262
1057199260,2cyclictest10854-21ssh22:48:382
1057199260,25cyclictest0-21swapper/223:07:162
1057199260,1cyclictest26933-21ssh22:00:582
1057199260,1cyclictest21669-21ssh23:29:102
1057199260,0cyclictest0-21swapper/222:40:192
1057199260,0cyclictest0-21swapper/200:30:202
1056499260,2cyclictest2874-21apt-get21:40:020
10572992523,2cyclictest0-21swapper/321:25:313
10572992520,5cyclictest0-21swapper/321:45:183
10572992520,4cyclictest8320-21ssh23:45:503
1057299250,25cyclictest0-21swapper/300:31:173
1057299250,24cyclictest4179-21diskmemload22:00:333
1057299250,24cyclictest0-21swapper/323:14:493
1057299250,24cyclictest0-21swapper/322:19:103
1057299250,24cyclictest0-21swapper/321:14:273
1057299250,21cyclictest6105-21ssh22:12:533
1057299250,1cyclictest24130-21ssh21:59:423
10571992521,4cyclictest4179-21diskmemload00:15:502
10571992521,4cyclictest4179-21diskmemload00:05:102
10571992520,4cyclictest0-21swapper/200:23:042
1057199250,25cyclictest0-21swapper/221:10:182
1057199250,24cyclictest0-21swapper/222:17:552
1057199250,20cyclictest0-21swapper/200:10:282
1057199250,1cyclictest6763-21ssh21:42:142
1057199250,1cyclictest5254-21ssh22:11:272
1057199250,1cyclictest31208-21ssh00:39:402
1057199250,0cyclictest6218-21apt-get23:45:202
1057199250,0cyclictest0-21swapper/223:51:332
1057199250,0cyclictest0-21swapper/221:23:422
10565992523,1cyclictest0-21swapper/121:56:121
1056599250,24cyclictest4938-21ssh22:11:021
1056599250,24cyclictest15631-21ssh22:21:191
1056599250,24cyclictest10113-21df21:15:201
10564992524,1cyclictest4179-21diskmemload22:58:410
1056499250,24cyclictest0-21swapper/000:15:030
1056499250,24cyclictest0-21swapper/000:07:280
10572992421,3cyclictest0-21swapper/322:58:553
10572992421,2cyclictest27908-21basename23:05:003
10572992420,4cyclictest4179-21diskmemload22:51:103
10572992420,4cyclictest0-21swapper/323:50:253
10572992420,3cyclictest0-21swapper/300:26:593
10572992420,0cyclictest0-21swapper/323:56:423
10572992419,1cyclictest0-21swapper/323:27:103
1057299240,24cyclictest0-21swapper/322:36:553
1057299240,23cyclictest0-21swapper/322:40:593
1057299240,21cyclictest4179-21diskmemload21:33:043
1057299240,20cyclictest0-21swapper/320:25:213
1057299240,0cyclictest0-21swapper/300:23:483
1057299240,0cyclictest0-21swapper/300:14:573
10571992423,1cyclictest4179-21diskmemload22:09:192
10571992420,3cyclictest0-21swapper/223:31:252
10571992419,4cyclictest4179-21diskmemload23:11:112
1057199240,24cyclictest4179-21diskmemload21:54:462
1057199240,23cyclictest26518-21ssh22:32:022
1057199240,20cyclictest4179-21diskmemload21:35:422
1057199240,1cyclictest0-21swapper/222:20:212
1057199240,0cyclictest0-21swapper/223:37:272
1057199240,0cyclictest0-21swapper/223:03:522
1057199240,0cyclictest0-21swapper/222:53:212
1057199240,0cyclictest0-21swapper/221:56:102
1057199240,0cyclictest0-21swapper/221:17:492
1057199240,0cyclictest0-21swapper/200:00:422
10565992422,1cyclictest0-21swapper/100:00:221
10565992421,2cyclictest606-21dbus-daemon00:40:001
10565992421,2cyclictest3369-21ssh23:41:561
1056599240,24cyclictest0-21swapper/122:39:421
1056599240,23cyclictest0-21swapper/122:27:391
10564992421,2cyclictest606-21dbus-daemon23:40:000
1056499240,24cyclictest0-21swapper/022:22:550
1056499240,24cyclictest0-21swapper/021:48:110
1056499240,23cyclictest8865-21seq23:46:450
1056499240,23cyclictest7891-21rm22:15:120
1056499240,23cyclictest4179-21diskmemload22:07:340
1056499240,22cyclictest955-21sh22:39:370
1056499240,0cyclictest4179-21diskmemload22:34:190
1056499240,0cyclictest0-21swapper/023:59:150
10572992323,0cyclictest0-21swapper/323:15:513
10572992323,0cyclictest0-21swapper/321:35:543
10572992321,2cyclictest0-21swapper/321:19:163
10572992321,2cyclictest0-21swapper/300:15:543
10572992320,3cyclictest0-21swapper/323:35:533
10572992320,2cyclictest18698-21sh21:54:263
10572992319,0cyclictest0-21swapper/323:06:553
1057299230,2cyclictest606-21dbus-daemon20:20:013
1057299230,2cyclictest22404-21sh23:30:033
1057299230,22cyclictest26707-21apt-get00:35:183
1057299230,22cyclictest21806-21sendmail20:40:003
1057299230,0cyclictest0-21swapper/323:23:543
1057299230,0cyclictest0-21swapper/322:08:193
10571992318,4cyclictest0-21swapper/219:20:192
1057199230,3cyclictest11829-21hddtemp_smartct19:10:282
1057199230,23cyclictest0-21swapper/223:22:432
1057199230,22cyclictest4179-21diskmemload00:29:382
1057199230,20cyclictest4179-21diskmemload23:42:392
1057199230,1cyclictest0-21swapper/221:30:012
10565992323,0cyclictest0-21swapper/122:50:241
10565992321,2cyclictest29248-21sh21:33:521
10565992321,1cyclictest9005-21ssh21:14:331
10565992321,1cyclictest0-21swapper/123:57:331
10565992321,1cyclictest0-21swapper/123:45:551
10565992321,1cyclictest0-21swapper/121:27:501
10565992320,2cyclictest28709-21ssh22:03:401
10565992320,2cyclictest28409-21cron22:35:011
1056599230,2cyclictest9995-21ssh22:15:491
1056599230,23cyclictest0-21swapper/100:26:391
1056599230,22cyclictest32280-21sh22:06:131
1056599230,22cyclictest2439-21hddtemp_smartct22:40:211
1056599230,22cyclictest17214-21ssh23:25:051
1056599230,22cyclictest17181-21rm21:21:041
1056599230,22cyclictest10953-21ssh00:20:031
1056599230,22cyclictest0-21swapper/123:50:171
1056599230,22cyclictest0-21swapper/122:45:351
1056599230,22cyclictest0-21swapper/120:35:161
1056599230,22cyclictest0-21swapper/120:10:011
1056599230,22cyclictest0-21swapper/100:30:091
1056599230,22cyclictest0-21swapper/100:12:171
1056599230,1cyclictest0-21swapper/123:15:221
1056599230,0cyclictest0-21swapper/122:55:251
1056599230,0cyclictest0-21swapper/121:45:281
10564992323,0cyclictest62550irq/127-eno122:10:340
10564992323,0cyclictest0-21swapper/023:51:200
10564992323,0cyclictest0-21swapper/021:59:260
10564992323,0cyclictest0-21swapper/020:55:190
10564992323,0cyclictest0-21swapper/000:24:010
10564992323,0cyclictest0-21swapper/000:13:110
10564992322,1cyclictest62550irq/127-eno123:28:220
10564992321,1cyclictest21463-21apt-get00:30:190
10564992321,1cyclictest0-21swapper/021:52:540
10564992320,2cyclictest22680-21ssh21:26:300
1056499230,23cyclictest0-21swapper/022:49:050
1056499230,22cyclictest3390-21grep23:10:280
1056499230,22cyclictest30804-21cpuspeed_turbos21:35:200
1056499230,22cyclictest30064-21ssh00:37:570
1056499230,22cyclictest25887-21diskmemload23:01:520
1056499230,22cyclictest18462-21sh22:25:170
1056499230,22cyclictest1379-21sh23:40:230
1056499230,22cyclictest0-21swapper/022:50:200
1056499230,22cyclictest0-21swapper/021:20:200
1056499230,1cyclictest0-21swapper/023:30:290
1056499230,0cyclictest4179-21diskmemload23:17:260
1056499230,0cyclictest0-21swapper/000:25:210
10572992220,1cyclictest2572-21awk20:00:003
10572992220,1cyclictest0-21swapper/320:50:003
1057299220,22cyclictest0-21swapper/321:20:553
1057299220,21cyclictest0-21swapper/322:26:303
1057299220,21cyclictest0-21swapper/300:00:183
1057299220,1cyclictest4190-21cron21:10:013
1057299220,1cyclictest27234-21apt-get20:50:023
10571992220,1cyclictest24206-21cron20:45:002
1057199220,1cyclictest15948-21ntp_states20:25:262
1057199220,1cyclictest0-21swapper/219:40:002
10565992221,0cyclictest22102-21apt-get20:40:171
10565992220,1cyclictest606-21dbus-daemon19:35:011
10565992220,1cyclictest32098-21apt-get21:00:171
10565992219,2cyclictest5795-21ssh00:15:091
10565992218,3cyclictest25646-21apt-get19:40:181
1056599221,21cyclictest14479-1kworker/u9:000:07:121
1056599220,22cyclictest1200-21ssh21:37:221
1056599220,21cyclictest31827-21munin-run21:00:011
1056599220,21cyclictest14632-21perf20:25:011
1056599220,21cyclictest0-21swapper/123:35:191
1056599220,21cyclictest0-21swapper/123:12:321
1056599220,21cyclictest0-21swapper/123:05:061
1056599220,21cyclictest0-21swapper/123:00:031
1056599220,21cyclictest0-21swapper/121:40:171
1056599220,21cyclictest0-21swapper/119:50:191
1056599220,1cyclictest16361-21ssh21:50:471
1056599220,1cyclictest14523-21ssh23:21:111
1056599220,1cyclictest0-21swapper/123:30:081
1056599220,1cyclictest0-21swapper/121:10:011
10564992222,0cyclictest0-21swapper/021:30:020
10564992220,1cyclictest9663-21/usr/sbin/munin21:15:210
1056499220,21cyclictest4179-21diskmemload23:20:050
1056499220,21cyclictest29485-21ssh23:05:220
1056499220,21cyclictest19685-21apt-get20:35:160
1056499220,21cyclictest0-21swapper/022:00:220
1056499220,1cyclictest15770-21perf19:20:010
1056499220,1cyclictest15770-21perf19:20:010
1056499220,1cyclictest0-21swapper/022:40:140
1056499220,1cyclictest0-21swapper/000:00:440
10572992121,0cyclictest0-21swapper/319:20:183
10572992119,1cyclictest20564-21munin-plugin-st19:30:013
1057299210,20cyclictest20833-21apt-get19:30:173
1057299210,1cyclictest28041-21apt-get19:45:193
1057299210,0cyclictest0-21swapper/319:15:183
1057299210,0cyclictest0-21swapper/319:15:183
10571992119,1cyclictest19414-21perf20:35:002
1057199211,14cyclictest1208-21awk19:55:222
1057199210,21cyclictest0-21swapper/220:05:192
1057199210,1cyclictest18854-21df_inode19:25:192
1057199210,1cyclictest10577-21fw_packets20:15:202
1057199210,0cyclictest0-21swapper/220:35:162
1057199210,0cyclictest0-21swapper/219:40:182
10565992121,0cyclictest10458-21apt-get19:10:021
10565992119,1cyclictest27287-21apt-get20:50:181
10565992119,1cyclictest16045-21apt-get19:20:181
1056599210,0cyclictest0-21swapper/120:30:201
10564992120,1cyclictest18438-21apt-get19:25:180
1056499210,20cyclictest23231-21apt-get19:35:190
1056499210,20cyclictest0-21swapper/020:00:180
1056499210,0cyclictest0-21swapper/019:50:190
10572992020,0cyclictest0-21swapper/320:10:183
1057199205,14cyclictest30982-21rt-features20:55:262
10571992020,0cyclictest0-21swapper/220:45:162
1057199200,1cyclictest4953-21perf20:05:012
1057199200,0cyclictest0-21swapper/219:45:192
10565992020,0cyclictest0-21swapper/120:25:211
10565992020,0cyclictest0-21swapper/119:55:191
10565992020,0cyclictest0-21swapper/119:35:191
1056599200,0cyclictest0-21swapper/120:15:181
10564992020,0cyclictest0-21swapper/021:00:180
10564992020,0cyclictest0-21swapper/020:30:200
10564992020,0cyclictest0-21swapper/019:55:190
10564992020,0cyclictest0-21swapper/019:20:190
10564992019,0cyclictest12446-21apt-get20:20:180
10564992018,1cyclictest0-21swapper/019:50:000
1056499200,20cyclictest0-21swapper/021:05:200
1056499200,0cyclictest0-21swapper/020:40:170
1056499200,0cyclictest0-21swapper/019:30:170
1057199190,1cyclictest0-21swapper/219:15:262
1057199190,1cyclictest0-21swapper/219:15:262
1057199190,0cyclictest0-21swapper/220:10:222
10565991919,0cyclictest0-21swapper/120:10:181
10565991919,0cyclictest0-21swapper/120:00:181
10572991817,0cyclictest30434-21apt-get19:50:193
10572991816,1cyclictest1810-21grep21:05:013
10565991818,0cyclictest0-21swapper/119:15:181
10565991818,0cyclictest0-21swapper/119:15:181
10572991717,0cyclictest0-21swapper/320:20:183
10572991714,2cyclictest12235-21ntp_states19:10:313
1057199170,1cyclictest31482-21ntp_states19:50:242
1057199170,16cyclictest0-21swapper/219:30:172
10565991717,0cyclictest0-21swapper/119:25:181
10564991717,0cyclictest0-21swapper/019:40:180
10564991715,1cyclictest29416-21perf20:55:010
10572991616,0cyclictest0-21swapper/319:35:193
10572991614,1cyclictest0-21swapper/320:55:193
1057199160,0cyclictest0-21swapper/221:05:302
10564991616,0cyclictest26626-21perf20:50:010
10564991614,1cyclictest5843-21gltestperf20:05:210
1056499160,15cyclictest111212chrt19:10:020
10572991513,1cyclictest4957-21apt20:05:013
10572991513,1cyclictest0-21swapper/320:05:203
10565991515,0cyclictest0-21swapper/119:45:191
10564991514,1cyclictest0-21swapper/020:10:180
10572991414,0cyclictest0-21swapper/320:40:173
1057299140,14cyclictest0-21swapper/319:41:553
1057299140,0cyclictest0-21swapper/320:30:293
1056499140,0cyclictest0-21swapper/020:27:330
1056499140,0cyclictest0-21swapper/020:15:300
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional