You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-13 - 17:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Mon Apr 13, 2026 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
29466992624,1cyclictest8518-21cron12:35:000
2948099250,24cyclictest8525-21cron12:35:003
2948099250,24cyclictest0-21swapper/311:40:363
2948099250,24cyclictest0-21swapper/310:11:153
2947699250,24cyclictest0-21swapper/211:56:522
2947699250,24cyclictest0-21swapper/210:58:412
2947699250,1cyclictest0-21swapper/212:11:042
2946699250,24cyclictest23210-21diskmemload09:23:110
2946699250,24cyclictest0-21swapper/009:34:560
29480992422,1cyclictest23210-21diskmemload10:34:373
29480992421,2cyclictest26358-21ssh10:47:063
2948099240,23cyclictest5807-21diskmemload12:00:443
2948099240,23cyclictest23210-21diskmemload09:48:213
2948099240,1cyclictest23210-21diskmemload10:58:533
29476992422,2cyclictest6646-21diskmemload11:29:482
2947699240,3cyclictest31291-21perf10:20:002
2947699240,24cyclictest0-21swapper/210:50:422
2947699240,23cyclictest25662-21sendmail-msp12:20:012
2947699240,23cyclictest23210-21diskmemload12:32:402
2947699240,23cyclictest23210-21diskmemload10:43:012
2947699240,23cyclictest23210-21diskmemload10:38:592
2947699240,23cyclictest23210-21diskmemload09:31:092
2947699240,23cyclictest23210-21diskmemload09:14:162
2947699240,23cyclictest0-21swapper/211:37:462
2947699240,1cyclictest24086-21apt-get10:14:302
2947699240,1cyclictest0-21swapper/212:24:322
29472992420,3cyclictest21601-21munin-run08:00:011
2947299241,22cyclictest22-21ksoftirqd/109:33:391
2947299240,24cyclictest23210-21diskmemload09:52:581
2947299240,24cyclictest0-21swapper/110:34:341
2947299240,24cyclictest0-21swapper/109:48:151
2947299240,23cyclictest0-21swapper/111:14:081
2947299240,1cyclictest23210-21diskmemload11:29:411
2947299240,0cyclictest0-21swapper/109:43:551
2946699240,2cyclictest27765-21rm10:17:150
2946699240,24cyclictest23210-21diskmemload11:33:060
2946699240,24cyclictest0-21swapper/010:02:420
2946699240,23cyclictest25602-21ssh12:20:010
29480992323,0cyclictest23210-21diskmemload11:12:093
29480992323,0cyclictest0-21swapper/311:25:273
29480992323,0cyclictest0-21swapper/311:21:053
29480992323,0cyclictest0-21swapper/311:06:253
29480992323,0cyclictest0-21swapper/309:54:033
29480992323,0cyclictest0-21swapper/309:18:363
29480992321,1cyclictest0-21swapper/311:30:433
29480992321,1cyclictest0-21swapper/310:15:243
29480992321,1cyclictest0-21swapper/309:39:173
2948099230,2cyclictest18119-21rm10:39:343
2948099230,23cyclictest0-21swapper/312:19:203
2948099230,23cyclictest0-21swapper/312:13:193
2948099230,23cyclictest0-21swapper/311:01:243
2948099230,23cyclictest0-21swapper/310:27:293
2948099230,23cyclictest0-21swapper/310:27:293
2948099230,23cyclictest0-21swapper/310:05:273
2948099230,22cyclictest27795-21ssh11:50:313
2948099230,22cyclictest26348-21ssh12:20:513
2948099230,22cyclictest23210-21diskmemload10:54:323
2948099230,22cyclictest16040-21awk08:55:013
2948099230,0cyclictest0-21swapper/309:55:323
2948099230,0cyclictest0-21swapper/309:32:383
29476992323,0cyclictest0-21swapper/211:17:332
29476992323,0cyclictest0-21swapper/211:12:012
29476992321,1cyclictest0-21swapper/210:46:122
2947699230,2cyclictest31587-21awk08:20:012
2947699230,22cyclictest30518-21ssh09:18:112
2947699230,22cyclictest2203-21ssh09:21:252
2947699230,22cyclictest16948-21sh09:35:322
2947699230,22cyclictest0-21swapper/211:20:282
2947699230,0cyclictest0-21swapper/211:51:572
29472992323,0cyclictest0-21swapper/112:01:081
29472992323,0cyclictest0-21swapper/111:45:351
29472992323,0cyclictest0-21swapper/111:38:041
29472992323,0cyclictest0-21swapper/111:15:431
29472992323,0cyclictest0-21swapper/109:57:021
29472992323,0cyclictest0-21swapper/109:12:441
29472992322,1cyclictest0-21swapper/111:59:291
29472992321,1cyclictest0-21swapper/111:53:511
29472992321,1cyclictest0-21swapper/110:17:201
29472992321,1cyclictest0-21swapper/109:15:331
29472992320,2cyclictest1553-21sh08:25:001
2947299230,2cyclictest25116-21ssh10:45:081
2947299230,23cyclictest0-21swapper/111:20:261
2947299230,22cyclictest18039-21latency_hist11:10:001
2947299230,22cyclictest17232-21ssh09:35:571
2947299230,0cyclictest11519-21ssh12:06:411
2947299230,0cyclictest0-21swapper/110:37:161
2947299230,0cyclictest0-21swapper/110:25:081
2947299230,0cyclictest0-21swapper/110:25:081
29466992323,0cyclictest23210-21diskmemload10:51:000
29466992323,0cyclictest23210-21diskmemload09:11:450
29466992323,0cyclictest0-21swapper/012:29:260
29466992323,0cyclictest0-21swapper/012:02:380
29466992323,0cyclictest0-21swapper/011:40:360
29466992323,0cyclictest0-21swapper/011:25:270
29466992323,0cyclictest0-21swapper/010:31:420
29466992322,1cyclictest30337-21ssh12:24:410
29466992320,2cyclictest0-21swapper/011:20:200
2946699230,2cyclictest16490-21ssh10:05:320
2946699230,23cyclictest0-21swapper/011:18:400
2946699230,23cyclictest0-21swapper/009:42:110
2946699230,22cyclictest936-21ssh11:56:100
2946699230,22cyclictest23469-21sh11:46:460
2946699230,22cyclictest2159-21ssh09:53:330
2946699230,22cyclictest16371-21diskmemload11:09:320
2946699230,21cyclictest0-21swapper/008:24:320
2946699230,0cyclictest0-21swapper/012:06:000
2946699230,0cyclictest0-21swapper/010:59:500
29480992222,0cyclictest0-21swapper/312:06:193
29480992222,0cyclictest0-21swapper/309:40:573
29480992222,0cyclictest0-21swapper/309:10:503
29480992221,1cyclictest0-21swapper/311:38:253
29480992220,1cyclictest19175-21latency_hist07:55:003
29480992220,1cyclictest0-21swapper/307:35:003
2948099220,22cyclictest0-21swapper/311:46:043
2948099220,22cyclictest0-21swapper/310:20:093
2948099220,21cyclictest9644-21ssh12:36:283
2948099220,21cyclictest4580-21apt-get08:34:303
2948099220,21cyclictest19044-21apt-get09:04:303
2948099220,21cyclictest0-21swapper/311:16:293
2948099220,21cyclictest0-21swapper/310:41:393
2948099220,21cyclictest0-21swapper/308:14:303
2948099220,1cyclictest606-21dbus-daemon08:20:013
2948099220,1cyclictest4637-21perf07:25:013
2948099220,1cyclictest313-21systemd-journal09:00:013
2948099220,1cyclictest12415-21sh10:02:583
2948099220,1cyclictest0-21swapper/312:25:443
29476992222,0cyclictest0-21swapper/212:25:152
29476992222,0cyclictest0-21swapper/209:43:102
29476992221,1cyclictest23210-21diskmemload11:48:182
29476992221,1cyclictest0-21swapper/209:50:342
29476992220,1cyclictest0-21swapper/210:22:562
2947699220,21cyclictest5004-21ssh10:26:182
2947699220,21cyclictest5004-21ssh10:26:182
2947699220,21cyclictest32202-21apt-get08:24:322
2947699220,21cyclictest23210-21diskmemload09:45:202
2947699220,21cyclictest13152-21cat10:34:372
2947699220,21cyclictest0-21swapper/212:35:152
2947699220,21cyclictest0-21swapper/212:06:122
2947699220,21cyclictest0-21swapper/212:00:062
2947699220,21cyclictest0-21swapper/211:00:122
2947699220,21cyclictest0-21swapper/209:27:372
2947699220,21cyclictest0-21swapper/207:54:302
2947699220,1cyclictest19442-21ssh11:43:292
2947699220,1cyclictest0-21swapper/211:30:212
2947699220,1cyclictest0-21swapper/211:09:322
2947699220,1cyclictest0-21swapper/210:05:562
2947699220,1cyclictest0-21swapper/210:03:452
2947699220,1cyclictest0-21swapper/209:55:562
2947699220,1cyclictest0-21swapper/208:05:012
2947699220,0cyclictest0-21swapper/208:34:302
29472992222,0cyclictest0-21swapper/112:30:391
29472992222,0cyclictest0-21swapper/112:25:501
29472992222,0cyclictest0-21swapper/112:20:451
29472992222,0cyclictest0-21swapper/112:10:361
29472992220,1cyclictest3860-21ssh10:56:351
29472992220,1cyclictest2832-21apt-get07:24:291
29472992220,1cyclictest20848-21sh12:15:161
2947299220,21cyclictest8897-21ssh12:35:121
2947299220,21cyclictest20763-21sh10:41:191
2947299220,21cyclictest11903-21sh07:40:001
2947299220,21cyclictest0-21swapper/110:20:311
2947299220,21cyclictest0-21swapper/110:11:041
2947299220,1cyclictest6973-21apt-get08:39:281
2947299220,1cyclictest30415-21ssh10:50:261
2947299220,1cyclictest0-21swapper/111:31:551
2947299220,1cyclictest0-21swapper/111:01:381
2947299220,1cyclictest0-21swapper/110:00:451
2947299220,1cyclictest0-21swapper/109:28:021
2947299220,1cyclictest0-21swapper/109:20:421
29466992222,0cyclictest23210-21diskmemload11:01:240
29466992222,0cyclictest23210-21diskmemload10:20:090
29466992222,0cyclictest23210-21diskmemload09:58:340
29466992222,0cyclictest23210-21diskmemload09:18:470
29466992222,0cyclictest0-21swapper/010:27:290
29466992222,0cyclictest0-21swapper/010:27:290
29466992222,0cyclictest0-21swapper/010:11:150
29466992221,1cyclictest62550irq/127-eno109:35:420
29466992220,2cyclictest0-21swapper/010:40:260
29466992220,1cyclictest29782-21apt-get08:19:300
2946699220,22cyclictest15218-21ssh10:35:440
2946699220,21cyclictest9017-21ssh12:35:240
2946699220,21cyclictest6787-21ssh09:25:380
2946699220,21cyclictest6373-21perf08:35:000
2946699220,21cyclictest28237-21ssh09:46:360
2946699220,21cyclictest0-21swapper/012:10:210
2946699220,21cyclictest0-21swapper/011:40:000
2946699220,21cyclictest0-21swapper/011:10:020
2946699220,21cyclictest0-21swapper/007:39:310
2946699220,1cyclictest2238-21munin-run07:20:010
2946699220,0cyclictest0-21swapper/011:50:310
29480992121,0cyclictest0-21swapper/311:57:433
2948099210,20cyclictest23210-21diskmemload09:21:043
2948099210,20cyclictest0-21swapper/308:24:323
2948099210,0cyclictest0-21swapper/309:25:543
29476992120,1cyclictest0-21swapper/208:49:322
29476992119,1cyclictest313-21systemd-journal07:20:012
29472992121,0cyclictest30428-21apt-get07:14:301
29472992121,0cyclictest0-21swapper/108:44:311
29472992120,1cyclictest0-21swapper/108:09:311
2947299210,21cyclictest0-21swapper/108:14:301
2947299210,1cyclictest0-21swapper/109:04:301
2947299210,0cyclictest23210-21diskmemload10:05:121
29466992120,1cyclictest4639-21munin-run07:25:010
2946699210,1cyclictest2182-21apt-get08:29:290
2946699210,0cyclictest9391-21apt-get08:44:320
2946699210,0cyclictest0-21swapper/008:39:280
29480992020,0cyclictest19777-21apt-get07:59:303
29480992020,0cyclictest0-21swapper/308:29:303
29480992020,0cyclictest0-21swapper/308:05:023
29480992020,0cyclictest0-21swapper/307:44:303
29480992018,1cyclictest21440-21apt-get09:09:313
29476992020,0cyclictest16629-21apt-get08:59:312
29476992020,0cyclictest12539-21apt-get07:44:302
29476992020,0cyclictest0-21swapper/208:39:282
29476992020,0cyclictest0-21swapper/207:34:302
29476992019,0cyclictest2182-21apt-get08:29:302
2947699200,20cyclictest0-21swapper/207:50:002
2947699200,0cyclictest0-21swapper/208:54:302
2947699200,0cyclictest0-21swapper/207:39:312
29472992020,0cyclictest0-21swapper/107:54:301
29472992020,0cyclictest0-21swapper/107:49:311
2947299200,0cyclictest0-21swapper/108:59:311
2947299200,0cyclictest0-21swapper/108:49:321
29466992020,0cyclictest0-21swapper/009:04:300
29466992020,0cyclictest0-21swapper/008:14:300
29466992020,0cyclictest0-21swapper/008:05:020
29466992020,0cyclictest0-21swapper/007:59:300
29480991918,1cyclictest1649-21cron08:05:013
29480991917,1cyclictest11887-21cron07:40:003
29476991919,0cyclictest0-21swapper/208:45:002
29476991919,0cyclictest0-21swapper/207:14:302
29476991917,1cyclictest0-21swapper/208:14:302
29472991919,0cyclictest0-21swapper/108:19:301
29472991916,2cyclictest14308-21idleruntime-cro07:45:001
29466991919,0cyclictest0-21swapper/007:34:300
29466991918,1cyclictest19174-21grep07:55:000
2946699190,18cyclictest14935-21apt-get07:49:310
29480991816,1cyclictest11173-21awk08:45:003
29480991815,2cyclictest606-21dbus-daemon07:20:013
29476991818,0cyclictest0-21swapper/209:04:302
29476991816,1cyclictest21598-21idleruntime-cro08:00:012
29472991818,0cyclictest0-21swapper/107:19:301
29466991818,0cyclictest0-21swapper/007:44:300
29466991816,1cyclictest24001-21munin-plugin-st08:05:010
29480991715,1cyclictest0-21swapper/307:30:013
29472991717,0cyclictest0-21swapper/108:04:301
29466991716,0cyclictest0-21swapper/009:09:310
29476991616,0cyclictest0-21swapper/207:24:292
29476991614,1cyclictest24983-21apt-get08:09:312
29476991614,1cyclictest23228-21turbostat09:10:012
29472991616,0cyclictest0-21swapper/108:54:301
29466991616,0cyclictest0-21swapper/008:54:300
2948099150,14cyclictest29381-21apt-get07:10:013
29472991515,0cyclictest0-21swapper/108:29:301
2947299150,3cyclictest0-21swapper/107:29:301
29466991513,1cyclictest7025-21munin-run07:30:010
29480991414,0cyclictest0-21swapper/308:35:573
29480991414,0cyclictest0-21swapper/307:46:563
2948099140,14cyclictest0-21swapper/308:45:403
2947699140,14cyclictest0-21swapper/207:25:082
29472991414,0cyclictest0-21swapper/108:30:351
29466991414,0cyclictest0-21swapper/007:10:010
2946699140,14cyclictest0-21swapper/008:55:390
2946699140,14cyclictest0-21swapper/008:45:040
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional