You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-30 - 22:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot5s.osadl.org (updated Mon Mar 30, 2026 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
892199260,25cyclictest16630-21ssh11:31:353
892199260,1cyclictest17988-21ssh09:57:533
8921992522,2cyclictest22226-21apt08:45:003
891599250,24cyclictest27514-21ssh11:09:581
891599250,24cyclictest2254-21diskmemload11:19:241
891099250,24cyclictest2254-21diskmemload12:37:130
8921992423,1cyclictest0-21swapper/310:44:593
8921992423,0cyclictest24055-21hddtemp_smartct10:03:233
8921992422,1cyclictest2254-21diskmemload10:49:353
892199240,24cyclictest0-21swapper/311:15:443
892199240,23cyclictest0-21swapper/309:34:053
8920992423,1cyclictest10750-21apt-get08:23:202
8920992422,1cyclictest0-21swapper/209:40:142
8920992419,4cyclictest0-21swapper/211:17:572
892099240,23cyclictest15036-21ssh10:26:052
892099240,23cyclictest13615-21perf12:00:002
892099240,23cyclictest0-21swapper/211:03:432
892099240,23cyclictest0-21swapper/209:24:092
891599240,24cyclictest0-21swapper/112:30:441
891599240,23cyclictest2254-21diskmemload10:11:131
891599240,23cyclictest0-21swapper/109:30:311
891599240,1cyclictest0-21swapper/109:45:401
8910992423,1cyclictest0-21swapper/009:30:500
8910992423,0cyclictest0-21swapper/010:19:280
8910992420,3cyclictest774-21runrttasks10:47:020
891099240,2cyclictest14465-21sh09:22:530
891099240,23cyclictest2254-21diskmemload12:04:070
891099240,23cyclictest2254-21diskmemload11:02:090
891099240,22cyclictest2254-21diskmemload09:46:000
891099240,22cyclictest0-21swapper/009:42:470
891099240,0cyclictest0-21swapper/010:25:430
8921992323,0cyclictest2254-21diskmemload09:39:573
8921992323,0cyclictest0-21swapper/311:39:063
8921992323,0cyclictest0-21swapper/310:30:443
8921992323,0cyclictest0-21swapper/309:22:403
8921992323,0cyclictest0-21swapper/309:10:163
8921992322,1cyclictest0-21swapper/310:14:133
892199232,20cyclictest331rcuc/309:50:223
8921992320,2cyclictest18456-21rm11:01:333
892199231,21cyclictest331rcuc/310:35:403
892199230,2cyclictest19047-21sh12:05:003
892199230,23cyclictest0-21swapper/311:26:173
892199230,23cyclictest0-21swapper/310:23:383
892199230,23cyclictest0-21swapper/309:46:443
892199230,22cyclictest636-21sh09:40:073
892199230,22cyclictest29235-21/usr/sbin/munin10:08:243
892199230,22cyclictest2254-21diskmemload11:12:143
892199230,22cyclictest16431-21ssh10:58:373
892199230,22cyclictest14979-21rm10:26:003
892199230,1cyclictest4500-21sh10:15:353
892199230,0cyclictest7796-21ssh11:53:573
892199230,0cyclictest0-21swapper/312:15:263
8920992323,0cyclictest2254-21diskmemload12:08:512
8920992323,0cyclictest0-21swapper/212:10:402
8920992323,0cyclictest0-21swapper/211:33:512
8920992323,0cyclictest0-21swapper/210:41:352
8920992323,0cyclictest0-21swapper/210:23:422
8920992323,0cyclictest0-21swapper/209:30:592
8920992321,1cyclictest0-21swapper/211:07:402
8920992321,1cyclictest0-21swapper/209:56:452
8920992321,1cyclictest0-21swapper/207:45:012
8920992320,2cyclictest31722-21ssh10:10:222
8920992320,0cyclictest0-21swapper/210:04:522
892099230,23cyclictest0-21swapper/212:34:592
892099230,23cyclictest0-21swapper/210:53:212
892099230,22cyclictest31261-21sh10:10:012
892099230,22cyclictest28637-21sh10:38:492
892099230,22cyclictest0-21swapper/210:15:032
892099230,1cyclictest0-21swapper/209:10:042
892099230,0cyclictest2254-21diskmemload12:03:022
892099230,0cyclictest2254-21diskmemload09:51:512
892099230,0cyclictest0-21swapper/211:22:452
892099230,0cyclictest0-21swapper/210:49:222
892099230,0cyclictest0-21swapper/209:17:012
8915992323,0cyclictest2254-21diskmemload10:36:271
8915992323,0cyclictest2254-21diskmemload10:27:021
8915992323,0cyclictest0-21swapper/111:28:311
8915992323,0cyclictest0-21swapper/110:50:371
8915992323,0cyclictest0-21swapper/110:23:451
8915992323,0cyclictest0-21swapper/109:56:341
8915992323,0cyclictest0-21swapper/109:44:411
8915992323,0cyclictest0-21swapper/109:37:041
8915992323,0cyclictest0-21swapper/109:24:581
8915992321,1cyclictest28185-21sh10:07:561
8915992321,1cyclictest21879-21rm12:39:371
8915992321,1cyclictest0-21swapper/110:46:011
8915992320,2cyclictest21437-21sh11:36:041
891599230,23cyclictest0-21swapper/112:09:421
891599230,22cyclictest7892-21ssh09:15:311
891599230,22cyclictest26028-21ssh11:40:191
891599230,22cyclictest2254-21diskmemload12:16:041
891599230,22cyclictest0-21swapper/112:23:271
891599230,22cyclictest0-21swapper/110:18:121
891599230,1cyclictest0-21swapper/109:50:021
891599230,1cyclictest0-21swapper/109:11:531
891599230,0cyclictest0-21swapper/112:28:381
891599230,0cyclictest0-21swapper/112:10:541
891599230,0cyclictest0-21swapper/110:55:321
8910992323,0cyclictest2254-21diskmemload12:30:440
8910992323,0cyclictest0-21swapper/012:15:370
8910992323,0cyclictest0-21swapper/012:06:540
8910992322,1cyclictest0-21swapper/011:11:300
8910992322,1cyclictest0-21swapper/010:11:470
8910992321,1cyclictest0-21swapper/011:06:300
891099230,2cyclictest9290-21ssh10:20:010
891099230,23cyclictest0-21swapper/011:31:190
891099230,22cyclictest26037-21rm11:40:200
891099230,22cyclictest25843-21sh10:37:200
891099230,22cyclictest24339-21rm12:10:010
891099230,22cyclictest16475-21ssh09:55:280
891099230,22cyclictest10964-21ssh11:25:370
891099230,22cyclictest10502-21ssh11:57:550
891099230,0cyclictest2254-21diskmemload10:43:440
891099230,0cyclictest0-21swapper/012:25:130
891099230,0cyclictest0-21swapper/011:54:030
891099230,0cyclictest0-21swapper/010:51:100
891099230,0cyclictest0-21swapper/009:51:490
8921992222,0cyclictest2254-21diskmemload09:28:573
8921992222,0cyclictest0-21swapper/312:05:243
8921992222,0cyclictest0-21swapper/311:43:173
8921992221,1cyclictest7617-21ssh09:15:063
892199221,21cyclictest331rcuc/310:54:313
892199221,0cyclictest331rcuc/312:13:113
892199220,22cyclictest0-21swapper/312:34:193
892199220,21cyclictest7342-21ssh12:25:103
892199220,21cyclictest31739-21ssh11:46:173
892199220,21cyclictest23901-21apt-get07:43:203
892199220,21cyclictest2254-21diskmemload11:20:473
892199220,21cyclictest11767-21apt-get07:18:173
892199220,21cyclictest0-21swapper/308:18:183
892199220,1cyclictest17352-21ssh12:35:063
892199220,0cyclictest0-21swapper/311:55:093
8920992222,0cyclictest0-21swapper/210:31:302
8920992222,0cyclictest0-21swapper/209:35:082
892099221,20cyclictest5931-21apt-get08:13:202
892099220,22cyclictest0-21swapper/212:38:202
892099220,21cyclictest24633-21apt-get08:50:022
892099220,21cyclictest2254-21diskmemload09:25:152
892099220,21cyclictest21482-21apt-get07:38:192
892099220,21cyclictest0-21swapper/212:28:042
892099220,21cyclictest0-21swapper/212:20:222
892099220,21cyclictest0-21swapper/212:15:122
892099220,21cyclictest0-21swapper/211:50:462
892099220,21cyclictest0-21swapper/211:41:422
892099220,1cyclictest0-21swapper/211:46:382
892099220,1cyclictest0-21swapper/211:36:152
892099220,0cyclictest0-21swapper/209:45:242
8915992222,0cyclictest0-21swapper/111:54:031
8915992222,0cyclictest0-21swapper/111:33:181
8915992222,0cyclictest0-21swapper/111:12:441
8915992220,1cyclictest15037-21munin-plugin-st08:30:011
8915992220,1cyclictest0-21swapper/111:45:551
8915992220,1cyclictest0-21swapper/111:00:361
8915992220,1cyclictest0-21swapper/110:31:381
891599220,22cyclictest0-21swapper/110:00:281
891599220,21cyclictest17247-21ssh12:03:251
891599220,21cyclictest0-21swapper/111:21:581
891599220,21cyclictest0-21swapper/110:40:041
891599220,21cyclictest0-21swapper/108:05:001
891599220,1cyclictest11233-21cron07:15:001
891599220,1cyclictest0-21swapper/109:03:201
8910992222,0cyclictest0-21swapper/011:37:210
8910992222,0cyclictest0-21swapper/009:13:200
8910992221,1cyclictest26948-21ssh10:05:440
8910992220,2cyclictest0-21swapper/009:16:190
8910992220,1cyclictest606-21dbus-daemon09:05:010
8910992220,1cyclictest2254-21diskmemload09:25:530
891099220,22cyclictest2254-21diskmemload10:04:210
891099220,22cyclictest0-21swapper/009:36:220
891099220,21cyclictest2254-21diskmemload11:15:060
891099220,21cyclictest15036-21perf08:30:010
891099220,1cyclictest5413-21grep08:10:000
891099220,1cyclictest3403-21ssh12:22:080
891099220,0cyclictest0-21swapper/010:30:180
8921992121,0cyclictest16066-21sh07:25:003
8921992121,0cyclictest0-21swapper/308:23:203
8921992119,1cyclictest19840-21munin-run08:40:013
892199211,0cyclictest2254-21diskmemload12:20:353
892199210,20cyclictest0-21swapper/308:33:193
892199210,1cyclictest7828-21munin-run08:15:003
892199210,1cyclictest0-21swapper/307:48:213
8920992120,1cyclictest16086-21perf07:25:002
8920992120,1cyclictest0-21swapper/209:05:012
892099210,20cyclictest17941-21apt-get08:38:202
892099210,1cyclictest0-21swapper/208:05:002
892099210,1cyclictest0-21swapper/207:28:202
892099210,0cyclictest0-21swapper/208:58:192
891599210,21cyclictest0-21swapper/107:18:181
8910992121,0cyclictest0-21swapper/011:20:420
8910992121,0cyclictest0-21swapper/007:23:190
8910992120,1cyclictest0-21swapper/008:18:180
8910992120,0cyclictest15545-21apt-get08:33:190
891099210,20cyclictest0-21swapper/007:48:200
891099210,0cyclictest0-21swapper/011:45:230
891099210,0cyclictest0-21swapper/008:50:020
891099210,0cyclictest0-21swapper/008:38:200
891099210,0cyclictest0-21swapper/007:53:190
8921992020,0cyclictest0-21swapper/308:48:203
8921992020,0cyclictest0-21swapper/308:03:203
8921992020,0cyclictest0-21swapper/307:28:193
8921992020,0cyclictest0-21swapper/307:13:203
8921992017,2cyclictest23389-21grep07:40:013
892199200,0cyclictest0-21swapper/309:08:193
8920992019,0cyclictest9375-21apt-get07:13:202
8915992020,0cyclictest0-21swapper/108:38:201
8915992020,0cyclictest0-21swapper/107:43:201
8915992019,1cyclictest26295-21apt-get07:48:201
891599200,0cyclictest22755-21apt-get08:48:201
891599200,0cyclictest0-21swapper/108:43:201
891599200,0cyclictest0-21swapper/108:18:181
8910992020,0cyclictest0-21swapper/008:13:200
8910992019,0cyclictest21482-21apt-get07:38:200
8910992018,1cyclictest0-21swapper/007:20:000
8921991919,0cyclictest0-21swapper/308:28:193
8920991919,0cyclictest0-21swapper/207:18:182
8920991918,0cyclictest0-21swapper/207:50:012
8920991917,1cyclictest2279-21perf09:10:012
8915991919,0cyclictest0-21swapper/107:53:191
8915991918,0cyclictest14189-21apt-get07:23:191
8915991916,2cyclictest23384-21ls07:40:011
8920991818,0cyclictest0-21swapper/208:45:172
8915991818,0cyclictest0-21swapper/108:33:191
8921991717,0cyclictest0-21swapper/307:33:203
8921991717,0cyclictest0-21swapper/307:33:203
8921991715,1cyclictest25256-21apt-get08:50:023
8921991714,2cyclictest0-21swapper/308:00:003
8915991717,0cyclictest0-21swapper/108:50:021
8910991717,0cyclictest0-21swapper/008:43:200
8910991717,0cyclictest0-21swapper/007:58:200
8910991715,1cyclictest3039-21basename08:05:000
892199164,11cyclictest11818-21munin-node07:53:043
8921991616,0cyclictest0-21swapper/308:08:193
8921991614,1cyclictest313-21systemd-journal09:00:003
8921991613,2cyclictest32296-21turbostat.cron09:05:013
8920991616,0cyclictest0-21swapper/208:08:192
8920991614,1cyclictest0-21swapper/208:33:192
892099160,1cyclictest30625-21latency_hist07:55:002
8915991616,0cyclictest0-21swapper/108:13:201
891599160,15cyclictest634-21cut08:00:001
8910991616,0cyclictest0-21swapper/007:43:200
8910991615,1cyclictest16584-21apt-get07:28:190
8920991513,1cyclictest0-21swapper/208:18:232
892099150,14cyclictest0-21swapper/208:43:292
891099150,14cyclictest774-21runrttasks07:33:040
891099150,14cyclictest774-21runrttasks07:33:040
891099150,14cyclictest0-21swapper/008:48:220
892099140,14cyclictest0-21swapper/208:26:552
892099140,0cyclictest0-21swapper/207:57:002
892099140,0cyclictest0-21swapper/207:30:342
892099140,0cyclictest0-21swapper/207:30:342
8915991414,0cyclictest0-21swapper/108:20:051
891599140,14cyclictest0-21swapper/109:05:451
891599140,0cyclictest0-21swapper/108:55:301
891599140,0cyclictest0-21swapper/107:30:161
891599140,0cyclictest0-21swapper/107:30:161
8910991414,0cyclictest0-21swapper/007:13:350
891099140,14cyclictest0-21swapper/009:05:080
891099140,14cyclictest0-21swapper/008:55:150
891099140,14cyclictest0-21swapper/008:20:290
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional