You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-16 - 00:09

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Wed Jul 15, 2026 12:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
139099920,57rtkit-daemon0-21swapper/107:06:311
20472926944,15sleep30-21swapper/307:05:283
20522026849,14sleep20-21swapper/207:07:472
20508326445,13sleep00-21swapper/007:06:010
2397842420,4sleep33056-21PK-Backend08:45:133
20560699295,22cyclictest883-21dbus-daemon12:07:073
205606992810,15cyclictest257087-21perf09:34:593
205603992815,11cyclictest315231-21unin-run12:20:002
205606992710,15cyclictest42-21ksoftirqd/307:49:593
139099270,18rtkit-daemon257720-21df09:35:140
20560699267,6cyclictest292884-21expr11:15:133
20560699267,6cyclictest292884-21expr11:15:123
20560699267,5cyclictest312355-21expr12:10:123
2724272250,4sleep33056-21PK-Backend10:15:233
20560699256,5cyclictest246695-21dpkg09:05:133
20560699252,9cyclictest248153-21apt-get09:10:033
205606992516,7cyclictest883-21dbus-daemon08:06:413
20560699250,23cyclictest306194-21munin-run11:55:013
20560399250,23cyclictest221432-21timerwakeupswit07:50:232
139099250,3rtkit-daemon0-21swapper/007:46:230
20560699249,13cyclictest281873-21cron10:45:003
20560699246,4cyclictest227896-21ls08:10:133
20560699245,5cyclictest285875-21expr10:55:153
20560699245,5cyclictest209182-21cat07:15:233
20560699244,4cyclictest436-20systemd-journal08:57:403
20560699241,8cyclictest302740-21munin-run11:45:003
20560699241,21cyclictest229335-21/usr/sbin/munin08:15:203
205606992410,12cyclictest315204-21latency_hist12:20:013
205606992410,12cyclictest3056-21PK-Backend07:55:293
205606992410,12cyclictest3056-21PK-Backend07:40:003
20560699240,23cyclictest3056-21PK-Backend10:30:423
20560699240,1cyclictest0-21swapper/312:25:113
205593992411,12cyclictest297533-21unin-run11:29:591
205590992418,4cyclictest299281-21latency_hist11:35:000
20560699238,3cyclictest436-20systemd-journal08:39:553
20560699237,3cyclictest3056-21PK-Backend07:45:003
205606992320,2cyclictest0-21swapper/308:20:163
20560699231,8cyclictest209954-21apt07:20:123
20560699231,8cyclictest209954-21apt07:20:123
205606992318,4cyclictest3056-21PK-Backend11:00:503
205606992311,10cyclictest255365-21turbostat09:30:003
20560699230,8cyclictest304474-21sleep11:50:013
20560699230,3cyclictest978-21snmpd08:26:473
20560699230,21cyclictest271212-21perf10:15:013
205603992321,1cyclictest0-21swapper/212:14:592
205603992320,1cyclictest0-21swapper/210:36:312
205593992321,1cyclictest0-21swapper/109:06:401
205593992321,1cyclictest0-21swapper/107:18:451
20559099239,12cyclictest236056-21unin-run08:35:000
20560699227,3cyclictest316374-21switchtime12:20:223
20560699224,3cyclictest913-21gdbus07:15:003
205606992220,1cyclictest3056-21PK-Backend10:27:243
20560699221,9cyclictest238028-21apt08:40:113
205606992219,2cyclictest3056-21PK-Backend10:24:063
205606992219,2cyclictest3056-21PK-Backend09:53:453
205606992219,2cyclictest3056-21PK-Backend09:35:263
20560699221,8cyclictest268734-21ntpq10:05:203
20560699220,8cyclictest280220-21wc10:40:013
20560699220,7cyclictest245799-21ps09:00:193
20560699220,20cyclictest3056-21PK-Backend09:42:573
205603992220,1cyclictest0-21swapper/211:02:332
205603992220,1cyclictest0-21swapper/210:16:232
205603992220,1cyclictest0-21swapper/208:29:162
205603992220,1cyclictest0-21swapper/208:15:102
205603992214,6cyclictest239478-21cron08:45:002
20560399220,21cyclictest0-21swapper/211:20:372
20560399220,21cyclictest0-21swapper/207:25:072
20560399220,20cyclictest315835-21df12:20:142
20559399227,13cyclictest318712-21unin-run12:30:001
205593992220,1cyclictest3056-21PK-Backend12:06:271
205593992220,1cyclictest0-21swapper/111:39:021
205593992220,1cyclictest0-21swapper/109:54:321
205590992220,1cyclictest3056-21PK-Backend12:05:570
205590992220,1cyclictest3056-21PK-Backend08:57:100
205590992220,1cyclictest0-21swapper/012:04:350
20559099220,21cyclictest0-21swapper/007:24:370
20559099220,21cyclictest0-21swapper/007:24:360
20559099220,20cyclictest216704-21munin-run07:40:010
139099220,15rtkit-daemon3056-21PK-Backend08:06:501
139099220,15rtkit-daemon0-21swapper/108:56:041
139099220,14rtkit-daemon0-21swapper/011:40:210
3019832210,4sleep20-21swapper/211:40:182
20560699218,3cyclictest3056-21PK-Backend07:26:533
205606992119,1cyclictest3056-21PK-Backend12:34:383
205606992119,1cyclictest3056-21PK-Backend09:55:403
205606992119,1cyclictest3056-21PK-Backend09:47:233
205606992119,1cyclictest3056-21PK-Backend08:31:523
205606992119,1cyclictest3056-21PK-Backend08:00:163
20560699211,4cyclictest883-21dbus-daemon11:55:463
205606992110,10cyclictest354-21jbd2/sdb2-812:04:553
20560699210,1cyclictest283875-21apt10:50:123
20560699210,19cyclictest3056-21PK-Backend11:10:103
20560699210,19cyclictest3056-21PK-Backend11:10:093
205603992119,1cyclictest0-21swapper/212:03:102
205603992119,1cyclictest0-21swapper/210:51:522
205603992119,1cyclictest0-21swapper/210:33:122
205603992119,1cyclictest0-21swapper/210:29:542
205603992119,1cyclictest0-21swapper/210:00:202
205603992119,1cyclictest0-21swapper/208:46:202
205603992119,1cyclictest0-21swapper/208:06:042
205603992119,1cyclictest0-21swapper/207:48:132
20559399213,17cyclictest234280-21cron08:29:591
205593992119,1cyclictest0-21swapper/111:07:521
205593992119,1cyclictest0-21swapper/110:33:051
205593992119,1cyclictest0-21swapper/110:07:301
205593992119,1cyclictest0-21swapper/109:41:471
205593992119,1cyclictest0-21swapper/109:39:521
205593992119,1cyclictest0-21swapper/108:50:311
205593992119,1cyclictest0-21swapper/108:47:471
205593992119,1cyclictest0-21swapper/108:22:591
205593992119,1cyclictest0-21swapper/108:02:031
205593992119,1cyclictest0-21swapper/107:10:251
205593992118,2cyclictest3056-21PK-Backend11:51:181
205593992114,6cyclictest252001-21wc09:20:001
205593992113,6cyclictest1-21systemd09:30:001
20559399210,20cyclictest0-21swapper/111:58:291
20559399210,20cyclictest0-21swapper/107:23:581
20559399210,20cyclictest0-21swapper/107:23:581
205590992119,1cyclictest0-21swapper/012:39:020
205590992119,1cyclictest0-21swapper/011:26:490
205590992119,1cyclictest0-21swapper/011:21:220
205590992119,1cyclictest0-21swapper/010:57:020
205590992119,1cyclictest0-21swapper/009:56:320
205590992119,1cyclictest0-21swapper/009:52:390
205590992119,1cyclictest0-21swapper/009:41:520
205590992119,1cyclictest0-21swapper/009:03:390
205590992119,1cyclictest0-21swapper/008:37:560
205590992119,1cyclictest0-21swapper/008:15:540
205590992119,1cyclictest0-21swapper/007:17:270
205590992118,2cyclictest0-21swapper/011:20:000
205590992118,2cyclictest0-21swapper/011:20:000
205590992116,3cyclictest1788620-21WebKitWebProces10:24:230
205590992114,5cyclictest290258-21nm-dispatcher11:06:420
20559099210,20cyclictest13-21ksoftirqd/012:15:500
20559099210,20cyclictest0-21swapper/009:46:180
20559099210,20cyclictest0-21swapper/007:53:500
20559099210,19cyclictest3056-21PK-Backend08:20:330
139099210,14rtkit-daemon0-21swapper/108:34:071
139099210,14rtkit-daemon0-21swapper/010:54:060
139099210,13rtkit-daemon0-21swapper/008:41:410
20560699205,3cyclictest0-21swapper/311:30:233
205606992018,1cyclictest3056-21PK-Backend11:39:573
205606992018,1cyclictest3056-21PK-Backend11:21:393
205606992017,2cyclictest3056-21PK-Backend09:21:143
205606992017,2cyclictest3056-21PK-Backend09:21:143
205603992018,1cyclictest0-21swapper/212:26:492
205603992018,1cyclictest0-21swapper/211:51:212
205603992018,1cyclictest0-21swapper/211:38:432
205603992018,1cyclictest0-21swapper/210:08:392
205603992018,1cyclictest0-21swapper/209:29:322
205603992018,1cyclictest0-21swapper/209:11:212
205603992018,1cyclictest0-21swapper/208:50:582
205603992018,1cyclictest0-21swapper/208:02:462
205603992018,1cyclictest0-21swapper/207:55:292
205603992018,1cyclictest0-21swapper/207:42:322
20560399200,19cyclictest0-21swapper/211:56:342
20560399200,19cyclictest0-21swapper/211:47:142
20560399200,19cyclictest0-21swapper/211:28:022
20560399200,19cyclictest0-21swapper/211:11:532
20560399200,19cyclictest0-21swapper/211:11:532
20560399200,19cyclictest0-21swapper/211:09:092
20560399200,19cyclictest0-21swapper/210:57:542
20560399200,19cyclictest0-21swapper/207:36:512
205593992018,1cyclictest3056-21PK-Backend12:13:351
205593992018,1cyclictest3056-21PK-Backend10:37:441
205593992013,6cyclictest291353-21sed11:10:181
205593992013,6cyclictest291353-21sed11:10:171
205593992011,7cyclictest267351-21users10:00:231
205593992011,7cyclictest222885-21ntp_states07:55:211
20559399200,1cyclictest0-21swapper/112:16:531
20559399200,1cyclictest0-21swapper/110:21:491
20559399200,19cyclictest3056-21PK-Backend10:41:021
20559399200,19cyclictest0-21swapper/111:01:511
20559399200,19cyclictest0-21swapper/110:55:501
20559399200,19cyclictest0-21swapper/110:47:041
20559399200,19cyclictest0-21swapper/109:46:131
20559399200,19cyclictest0-21swapper/109:21:131
20559399200,19cyclictest0-21swapper/109:21:131
20559399200,19cyclictest0-21swapper/108:36:311
20559399200,19cyclictest0-21swapper/107:51:361
20559399200,19cyclictest0-21swapper/107:46:291
20559399200,19cyclictest0-21swapper/107:39:121
20559099206,12cyclictest281904-21unin-run10:45:010
205590992018,1cyclictest3056-21PK-Backend12:12:320
205590992018,1cyclictest3056-21PK-Backend10:06:120
205590992018,1cyclictest3056-21PK-Backend07:11:050
205590992018,1cyclictest0-21swapper/012:27:390
205590992018,1cyclictest0-21swapper/011:57:580
205590992018,1cyclictest0-21swapper/010:32:210
205590992018,1cyclictest0-21swapper/010:25:460
205590992018,1cyclictest0-21swapper/009:32:260
205590992018,1cyclictest0-21swapper/009:10:560
205590992018,1cyclictest0-21swapper/009:07:170
205590992018,1cyclictest0-21swapper/008:10:050
205590992018,1cyclictest0-21swapper/008:08:440
205590992018,1cyclictest0-21swapper/008:01:200
205590992017,2cyclictest0-21swapper/010:15:170
20559099200,19cyclictest0-21swapper/012:22:250
20559099200,19cyclictest0-21swapper/011:39:400
20559099200,19cyclictest0-21swapper/009:24:550
20559099200,19cyclictest0-21swapper/009:24:550
20559099200,19cyclictest0-21swapper/008:45:550
20559099200,19cyclictest0-21swapper/007:59:450
20559099200,19cyclictest0-21swapper/007:30:040
2739592190,9sleep234-21ksoftirqd/210:20:192
20560699196,3cyclictest3056-21PK-Backend10:49:323
20560699190,8cyclictest0-21swapper/309:20:003
20560699190,7cyclictest290542-21perf11:10:003
20560699190,1cyclictest3056-21PK-Backend08:54:233
20560699190,10cyclictest3056-21PK-Backend07:31:383
205603991917,1cyclictest0-21swapper/212:37:572
205603991917,1cyclictest0-21swapper/209:22:502
205603991917,1cyclictest0-21swapper/209:22:502
205603991917,1cyclictest0-21swapper/208:59:172
205603991917,1cyclictest0-21swapper/207:23:462
205603991917,1cyclictest0-21swapper/207:23:462
205603991917,1cyclictest0-21swapper/207:16:362
20560399190,1cyclictest0-21swapper/210:43:072
20560399190,1cyclictest0-21swapper/210:10:352
20560399190,1cyclictest0-21swapper/209:43:452
20560399190,1cyclictest0-21swapper/209:38:442
20560399190,1cyclictest0-21swapper/209:15:322
20560399190,18cyclictest0-21swapper/212:06:272
20560399190,18cyclictest0-21swapper/211:17:552
20560399190,18cyclictest0-21swapper/211:17:542
20560399190,18cyclictest0-21swapper/209:48:112
20560399190,18cyclictest0-21swapper/207:33:192
205593991917,1cyclictest3056-21PK-Backend10:51:101
205593991917,1cyclictest0-21swapper/108:43:071
205593991913,5cyclictest322173-21sed12:35:241
205593991913,5cyclictest26-21ksoftirqd/107:40:211
20559399190,1cyclictest3056-21PK-Backend09:03:011
20559399190,1cyclictest0-21swapper/111:32:131
20559399190,1cyclictest0-21swapper/109:58:241
20559399190,18cyclictest0-21swapper/112:34:181
20559399190,18cyclictest0-21swapper/111:21:171
20559399190,18cyclictest0-21swapper/111:18:341
20559399190,18cyclictest0-21swapper/111:18:341
205590991917,1cyclictest0-21swapper/011:51:230
205590991917,1cyclictest0-21swapper/010:46:200
205590991917,1cyclictest0-21swapper/008:26:560
205590991916,2cyclictest0-21swapper/007:41:260
205590991913,5cyclictest883-21dbus-daemon09:18:030
20559099190,1cyclictest3056-21PK-Backend10:35:390
20559099190,1cyclictest0-21swapper/012:30:100
20559099190,1cyclictest0-21swapper/010:10:040
20559099190,18cyclictest0-21swapper/007:25:580
205606991816,1cyclictest3056-21PK-Backend11:25:453
205606991815,2cyclictest3056-21PK-Backend12:36:353
205603991816,1cyclictest0-21swapper/209:32:372
205603991811,5cyclictest282942-21cut10:45:202
205603991811,5cyclictest235535-21wc08:30:192
20559399182,12cyclictest271480-21apt10:15:131
205593991816,1cyclictest0-21swapper/107:26:421
205593991811,5cyclictest26-21ksoftirqd/111:40:121
205590991816,1cyclictest0-21swapper/011:45:560
205590991816,1cyclictest0-21swapper/010:02:200
205590991812,4cyclictest288007-21cut11:00:170
205606991715,1cyclictest3056-21PK-Backend07:52:113
20560399172,14cyclictest1095-21runrttasks08:24:322
205603991715,1cyclictest0-21swapper/208:38:222
205603991711,4cyclictest298754-21grep11:30:252
205593991715,1cyclictest0-21swapper/112:21:331
205593991715,1cyclictest0-21swapper/108:13:541
205593991714,2cyclictest3056-21PK-Backend11:47:131
205593991711,5cyclictest269919-21expr10:10:111
205593991710,5cyclictest213728-21cat07:30:141
205590991715,1cyclictest0-21swapper/011:14:320
205590991715,1cyclictest0-21swapper/011:14:320
205590991715,1cyclictest0-21swapper/009:29:540
205590991715,1cyclictest0-21swapper/008:53:180
2666732160,4sleep33056-21PK-Backend10:00:153
20560399169,5cyclictest264291-21cpu09:55:122
205603991614,1cyclictest0-21swapper/209:52:032
205603991614,1cyclictest0-21swapper/209:07:422
205603991614,1cyclictest0-21swapper/209:04:042
205603991612,3cyclictest227739-21cpuspeed_turbos08:10:132
20559399169,5cyclictest248905-21expr09:10:131
20559399169,5cyclictest2156-21gnome-shell09:30:091
205593991614,1cyclictest0-21swapper/110:26:291
205593991610,4cyclictest308392-21expr12:00:131
205603991513,1cyclictest0-21swapper/212:31:152
205603991510,4cyclictest978-21snmpd07:11:242
20559399159,5cyclictest26-21ksoftirqd/108:15:201
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional