You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-20 - 16:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot5s.osadl.org (updated Wed May 20, 2026 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24763993130,1cyclictest34-21ksoftirqd/310:00:013
24759993020,5cyclictest348-21ssh09:52:302
24759993020,5cyclictest348-21ssh09:52:302
2475999290,25cyclictest0-21swapper/210:15:492
2475099271,22cyclictest18859-21cron08:05:000
2476399260,25cyclictest24552-21rm09:15:543
24759992621,4cyclictest0-21swapper/210:27:362
2475999260,25cyclictest0-21swapper/211:54:372
2475999260,25cyclictest0-21swapper/210:09:462
2475999260,21cyclictest30014-21apt-get12:12:362
2475999260,1cyclictest0-21swapper/210:49:262
24763992525,0cyclictest341ksoftirqd/311:51:043
24763992523,1cyclictest34-21ksoftirqd/312:00:003
2476399250,1cyclictest5068-21ssh11:49:413
24759992523,0cyclictest0-21swapper/210:57:182
24759992520,4cyclictest25307-21sh10:12:482
24759992520,4cyclictest0-21swapper/211:38:532
24759992518,6cyclictest0-21swapper/209:25:002
2475999250,24cyclictest0-21swapper/211:15:132
2475999250,24cyclictest0-21swapper/211:03:102
2475999250,24cyclictest0-21swapper/210:50:562
2475999250,24cyclictest0-21swapper/210:23:092
2475999250,24cyclictest0-21swapper/209:43:182
2475999250,1cyclictest7772-21sh11:23:152
2475999250,1cyclictest0-21swapper/212:05:162
2475999250,0cyclictest0-21swapper/212:24:352
2475999250,0cyclictest0-21swapper/212:15:472
2475999250,0cyclictest0-21swapper/212:04:362
2475999250,0cyclictest0-21swapper/210:37:192
2475999250,0cyclictest0-21swapper/209:12:322
2475099250,25cyclictest0-21swapper/011:49:540
2475099250,24cyclictest17715-21diskmemload11:58:140
2475099250,1cyclictest20140-21ssh11:06:570
24763992423,1cyclictest34-21ksoftirqd/309:40:003
24763992422,1cyclictest0-21swapper/312:34:343
24763992421,2cyclictest9296-21dump-pmu-power07:45:013
24763992421,0cyclictest34-21ksoftirqd/310:51:413
2476399240,23cyclictest8600-21ssh12:22:233
2476399240,23cyclictest17715-21diskmemload11:07:053
2476399240,23cyclictest0-21swapper/311:26:013
2476399240,23cyclictest0-21swapper/311:14:513
24759992421,1cyclictest0-21swapper/209:35:092
24759992420,3cyclictest0-21swapper/211:46:082
24759992418,5cyclictest17715-21diskmemload12:37:272
2475999240,23cyclictest17715-21diskmemload11:57:522
2475999240,23cyclictest17715-21diskmemload09:29:242
2475999240,23cyclictest0-21swapper/211:42:112
2475999240,20cyclictest0-21swapper/211:26:222
2475999240,20cyclictest0-21swapper/209:55:452
2475999240,0cyclictest17715-21diskmemload09:32:342
2475999240,0cyclictest0-21swapper/210:41:412
2475999240,0cyclictest0-21swapper/209:46:332
24754992424,0cyclictest0-21swapper/111:37:371
24754992422,1cyclictest606-21dbus-daemon08:40:001
24754992421,2cyclictest970-21cron12:15:011
24754992421,2cyclictest3454-21timerwakeupswit11:47:451
2475499240,24cyclictest0-21swapper/111:51:111
2475499240,24cyclictest0-21swapper/111:21:251
2475499240,23cyclictest9593-21ssh10:27:451
2475499240,23cyclictest0-21swapper/110:44:331
2475499240,23cyclictest0-21swapper/110:22:471
2475499240,23cyclictest0-21swapper/109:51:581
2475499240,23cyclictest0-21swapper/109:51:581
2475499240,1cyclictest13520-21fschecks_count11:57:391
2475499240,0cyclictest17715-21diskmemload09:32:551
2475499240,0cyclictest0-21swapper/109:36:531
24750992422,1cyclictest4777-21sh10:23:390
24750992422,1cyclictest23904-21munin-run09:15:010
24750992422,1cyclictest0-21swapper/010:37:300
2475099240,24cyclictest62550irq/127-eno111:54:190
2475099240,24cyclictest0-21swapper/010:59:020
2475099240,24cyclictest0-21swapper/009:17:010
2475099240,23cyclictest32400-21ssh09:51:550
2475099240,23cyclictest32400-21ssh09:51:550
2475099240,23cyclictest0-21swapper/010:28:390
2475099240,0cyclictest17715-21diskmemload09:45:380
2475099240,0cyclictest0-21swapper/009:57:240
2476399233,19cyclictest16474-21latency_hist08:00:003
24763992323,0cyclictest32531-21ssh12:13:453
24763992323,0cyclictest0-21swapper/312:04:553
24763992323,0cyclictest0-21swapper/310:19:353
24763992323,0cyclictest0-21swapper/310:10:403
24763992322,1cyclictest29575-21ssh10:46:253
24763992322,1cyclictest13706-21ssh09:34:403
24763992321,1cyclictest34-21ksoftirqd/310:57:333
24763992321,1cyclictest0-21swapper/312:17:183
2476399230,23cyclictest0-21swapper/310:42:023
2476399230,22cyclictest2950-21rm09:53:383
2476399230,22cyclictest2950-21rm09:53:383
2476399230,22cyclictest23693-21idleruntime-cro09:15:013
2476399230,1cyclictest30816-21latency_hist09:50:013
2476399230,0cyclictest0-21swapper/310:28:443
2476399230,0cyclictest0-21swapper/309:43:203
24759992323,0cyclictest0-21swapper/212:30:132
24759992322,1cyclictest17715-21diskmemload11:05:462
24759992320,3cyclictest0-21swapper/210:30:102
24759992320,2cyclictest18873-21cron08:05:002
24759992316,1cyclictest0-21swapper/208:27:372
2475999230,23cyclictest0-21swapper/212:27:242
2475999230,22cyclictest27781-21rm09:17:562
2475999230,22cyclictest1922-21perf07:30:012
2475999230,0cyclictest0-21swapper/210:01:552
24754992323,0cyclictest17715-21diskmemload10:56:351
24754992323,0cyclictest0-21swapper/110:34:231
24754992323,0cyclictest0-21swapper/109:27:101
24754992322,1cyclictest17715-21diskmemload09:20:241
24754992321,1cyclictest27864-21/usr/sbin/munin11:12:451
24754992321,1cyclictest20393-21sh11:34:251
24754992321,1cyclictest0-21swapper/112:36:561
24754992321,1cyclictest0-21swapper/111:29:281
24754992321,1cyclictest0-21swapper/111:07:481
24754992321,1cyclictest0-21swapper/110:18:371
24754992321,1cyclictest0-21swapper/109:12:041
2475499230,2cyclictest313-21systemd-journal08:50:001
2475499230,23cyclictest0-21swapper/112:16:571
2475499230,23cyclictest0-21swapper/111:40:081
2475499230,23cyclictest0-21swapper/111:16:011
2475499230,22cyclictest0-21swapper/112:00:451
2475499230,22cyclictest0-21swapper/111:01:481
2475499230,22cyclictest0-21swapper/110:36:581
2475499230,1cyclictest0-21swapper/112:29:311
2475499230,0cyclictest0-21swapper/110:48:241
2475499230,0cyclictest0-21swapper/109:56:411
24750992323,0cyclictest17715-21diskmemload12:08:050
24750992323,0cyclictest17715-21diskmemload10:40:060
24750992323,0cyclictest0-21swapper/012:37:130
24750992323,0cyclictest0-21swapper/011:11:010
24750992323,0cyclictest0-21swapper/010:32:510
24750992323,0cyclictest0-21swapper/010:11:340
24750992322,1cyclictest0-21swapper/010:49:020
24750992321,1cyclictest14415-21sh09:35:240
24750992321,1cyclictest0-21swapper/010:17:390
24750992320,2cyclictest5978-21diskmemload12:19:060
24750992320,2cyclictest31619-21ssh11:16:340
24750992320,2cyclictest16494-21perf08:00:000
2475099230,2cyclictest11682-21cat07:50:000
2475099230,23cyclictest0-21swapper/012:31:350
2475099230,23cyclictest0-21swapper/012:11:480
2475099230,22cyclictest7039-21ssh12:20:080
2475099230,22cyclictest30894-21idleruntime-cro08:30:010
2475099230,22cyclictest27839-21ssh11:41:390
2475099230,22cyclictest18917-21tr12:02:380
2475099230,22cyclictest17715-21diskmemload10:50:010
2475099230,22cyclictest15943-21ssh10:05:080
2475099230,22cyclictest13116-21ssh12:25:450
2475099230,22cyclictest0-21swapper/011:28:330
2475099230,0cyclictest17715-21diskmemload09:30:050
2475099230,0cyclictest0-21swapper/011:34:560
2475099230,0cyclictest0-21swapper/009:25:020
24763992222,0cyclictest0-21swapper/312:25:103
24763992222,0cyclictest0-21swapper/312:06:083
24763992222,0cyclictest0-21swapper/310:32:283
24763992221,1cyclictest31049-21ssh11:15:513
24763992220,1cyclictest1220-21sh10:21:133
24763992220,1cyclictest0-21swapper/311:00:053
24763992220,1cyclictest0-21swapper/309:05:013
24763992220,1cyclictest0-21swapper/308:45:003
2476399220,22cyclictest0-21swapper/310:00:333
2476399220,21cyclictest17715-21diskmemload10:37:453
2476399220,21cyclictest17715-21diskmemload09:21:273
2476399220,21cyclictest0-21swapper/308:47:373
2476399220,21cyclictest0-21swapper/308:40:003
2476399220,1cyclictest0-21swapper/311:20:523
2476399220,0cyclictest0-21swapper/311:40:133
2476399220,0cyclictest0-21swapper/311:31:543
2476399220,0cyclictest0-21swapper/309:25:013
2475999220,1cyclictest606-21dbus-daemon08:25:012
2475999220,1cyclictest25011-21ssh11:10:482
24754992222,0cyclictest0-21swapper/112:30:161
24754992222,0cyclictest0-21swapper/110:11:301
24754992221,1cyclictest0-21swapper/112:08:151
24754992220,1cyclictest6837-21perf07:40:011
24754992220,1cyclictest31907-21cron07:25:011
2475499220,22cyclictest0-21swapper/110:05:281
2475499220,22cyclictest0-21swapper/109:16:541
2475499220,21cyclictest26686-21sh09:46:441
2475499220,21cyclictest16476-21apt08:00:001
2475499220,1cyclictest0-21swapper/112:20:251
24750992222,0cyclictest0-21swapper/011:35:030
24750992222,0cyclictest0-21swapper/010:02:570
2475099220,22cyclictest0-21swapper/011:01:130
2475099220,22cyclictest0-21swapper/009:22:000
2475099220,21cyclictest0-21swapper/007:30:010
2475099220,1cyclictest8413-21rm11:24:020
2475099220,0cyclictest17715-21diskmemload09:41:570
24763992121,0cyclictest0-21swapper/310:05:263
24763992121,0cyclictest0-21swapper/308:52:373
24763992119,1cyclictest31944-21basename07:25:013
24763992119,1cyclictest10994-21apt-get08:57:393
2476399210,20cyclictest0-21swapper/312:35:073
2476399210,1cyclictest15797-21apt-get09:07:363
24754992121,0cyclictest0-21swapper/108:42:361
24754992119,1cyclictest31346-21apt-get08:32:341
2475499210,20cyclictest0-21swapper/107:47:371
2475499210,0cyclictest0-21swapper/108:57:381
2475099210,20cyclictest14047-21cron07:55:000
24763992020,0cyclictest0-21swapper/308:32:343
24763992020,0cyclictest0-21swapper/307:37:363
2476399200,0cyclictest0-21swapper/308:27:373
24759992020,0cyclictest0-21swapper/207:57:362
24759992020,0cyclictest0-21swapper/207:37:362
24759992018,1cyclictest606-21dbus-daemon07:50:002
2475999200,20cyclictest0-21swapper/208:37:372
2475999200,0cyclictest0-21swapper/208:32:342
24754992019,1cyclictest13407-21apt-get09:02:371
24754992018,1cyclictest26563-21apt-get08:22:381
24750992020,0cyclictest0-21swapper/008:42:360
24750992020,0cyclictest0-21swapper/008:32:340
24750992019,1cyclictest0-21swapper/009:07:360
2475099200,20cyclictest0-21swapper/007:42:370
2475099200,0cyclictest0-21swapper/008:47:370
2475099200,0cyclictest0-21swapper/007:17:360
24759991919,0cyclictest24136-21apt-get08:17:362
24759991917,1cyclictest12140-21apt-get07:52:382
24754991919,0cyclictest0-21swapper/107:17:361
24754991917,1cyclictest8543-21apt-get08:52:371
24754991917,1cyclictest1887-21cron07:30:011
24750991919,0cyclictest0-21swapper/008:37:370
24750991919,0cyclictest0-21swapper/008:07:370
24750991919,0cyclictest0-21swapper/007:22:370
24750991916,2cyclictest10518-21cron08:55:000
24750991914,4cyclictest0-21swapper/008:17:410
2475099190,18cyclictest0-21swapper/008:57:450
24763991818,0cyclictest0-21swapper/308:07:373
24763991818,0cyclictest0-21swapper/308:02:363
24754991816,1cyclictest30886-21turbostat08:30:011
24750991814,3cyclictest606-21dbus-daemon08:25:010
24763991716,1cyclictest27575-21apt-get07:17:363
2476399170,4cyclictest151rcu_preempt08:12:473
24759991715,1cyclictest609-21rs:main2
24754991717,0cyclictest25181-21apt-get07:12:371
24750991716,1cyclictest21742-21apt-get08:12:370
24763991616,0cyclictest0-21swapper/307:12:373
24763991614,1cyclictest0-21swapper/307:32:363
24759991616,0cyclictest3751-21apt-get08:42:362
24759991616,0cyclictest0-21swapper/208:57:382
24759991616,0cyclictest0-21swapper/207:42:372
24754991616,0cyclictest16949-21apt-get08:02:361
24754991616,0cyclictest0-21swapper/108:07:371
24759991515,0cyclictest0-21swapper/208:12:372
24759991515,0cyclictest0-21swapper/207:12:372
24759991512,2cyclictest29538-21grep07:20:002
2475999150,1cyclictest14053-21hddtemp_smartct09:02:402
2475999150,14cyclictest0-21swapper/207:22:452
24750991515,0cyclictest0-21swapper/007:32:360
24763991414,0cyclictest0-21swapper/307:50:033
2476399140,14cyclictest0-21swapper/308:20:123
2476399140,14cyclictest0-21swapper/307:25:043
2476399140,0cyclictest0-21swapper/308:15:163
2476399140,0cyclictest0-21swapper/307:45:223
2475999140,14cyclictest0-21swapper/209:05:132
2475999140,14cyclictest0-21swapper/208:45:292
2475999140,0cyclictest0-21swapper/208:06:582
2475999140,0cyclictest0-21swapper/207:30:062
2475499140,14cyclictest0-21swapper/109:05:361
2475499140,14cyclictest0-21swapper/108:15:081
2475499140,14cyclictest0-21swapper/108:10:051
2475499140,14cyclictest0-21swapper/107:50:101
24750991414,0cyclictest0-21swapper/009:00:280
2475099140,14cyclictest0-21swapper/007:36:410
2475099140,14cyclictest0-21swapper/007:12:060
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional