You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-26 - 14:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Sun Jul 26, 2026 00:44:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
199291021310,3sleep33056-21PK-Backend19:35:133
203547421050,5sleep33056-21PK-Backend21:35:153
209765721030,2sleep33056-21PK-Backend00:30:183
198174128147,23sleep10-21swapper/119:05:111
198314528040,15sleep20-21swapper/219:09:272
198316327638,14sleep30-21swapper/319:09:403
198309827639,13sleep00-21swapper/019:08:480
20609282470,3sleep20-21swapper/222:45:222
1983334993328,4cyclictest2061818-21tr22:50:140
1983334993328,4cyclictest2061818-21tr22:50:140
1983348992714,11cyclictest2031394-21unin-run21:25:003
139099270,4rtkit-daemon1389-21rtkit-daemon22:51:441
139099270,4rtkit-daemon1389-21rtkit-daemon22:51:441
139099270,4rtkit-daemon1389-21rtkit-daemon20:46:261
1983334992514,9cyclictest2035473-21diskstats21:35:150
1983348992416,6cyclictest1995311-21python319:40:373
198333999240,23cyclictest1389-21rtkit-daemon20:32:381
20782942230,6sleep10-21swapper/123:35:231
198334899236,4cyclictest2091914-21cat00:15:153
1983343992321,1cyclictest0-21swapper/219:47:432
1983343992315,6cyclictest2068139-21sshd23:07:272
198334399230,3cyclictest2081779-21sed23:45:232
1983334992312,9cyclictest2088167-21cstates00:05:160
20950572220,8sleep342-21ksoftirqd/300:25:013
1983348992214,6cyclictest2015461-21cron20:40:003
1983343992220,1cyclictest0-21swapper/220:21:572
198334399220,21cyclictest0-21swapper/200:14:572
1983339992219,2cyclictest0-21swapper/120:05:171
1983339992216,5cyclictest2047218-21cron22:10:001
198333999220,21cyclictest1389-21rtkit-daemon21:46:131
1983334992220,1cyclictest0-21swapper/023:54:490
1983334992220,1cyclictest0-21swapper/023:49:490
1983334992220,1cyclictest0-21swapper/023:27:320
1983334992220,1cyclictest0-21swapper/023:20:010
1983334992220,1cyclictest0-21swapper/021:05:160
1983334992220,1cyclictest0-21swapper/019:56:550
1983334992220,1cyclictest0-21swapper/000:03:000
198333499220,21cyclictest0-21swapper/021:10:500
198333499220,21cyclictest0-21swapper/000:35:040
198333499220,20cyclictest2068362-21ls23:10:000
139099220,4rtkit-daemon1389-21rtkit-daemon19:49:140
139099220,3rtkit-daemon1389-21rtkit-daemon21:53:561
139099220,3rtkit-daemon1389-21rtkit-daemon21:53:561
139099220,19rtkit-daemon1788643-21eadedCompositor20:38:310
1983348992115,4cyclictest42-21ksoftirqd/319:30:203
198334899210,20cyclictest3056-21PK-Backend22:03:173
198334899210,1cyclictest0-21swapper/322:42:183
198334899210,19cyclictest3056-21PK-Backend22:35:273
198334899210,19cyclictest3056-21PK-Backend21:33:443
1983343992119,1cyclictest0-21swapper/223:53:212
1983343992119,1cyclictest0-21swapper/223:23:132
1983343992119,1cyclictest0-21swapper/222:22:352
1983343992119,1cyclictest0-21swapper/221:40:452
1983343992119,1cyclictest0-21swapper/221:20:172
1983343992119,1cyclictest0-21swapper/221:14:562
1983343992119,1cyclictest0-21swapper/220:54:352
1983343992119,1cyclictest0-21swapper/220:25:282
1983343992119,1cyclictest0-21swapper/220:11:022
1983343992119,1cyclictest0-21swapper/220:03:042
1983343992119,1cyclictest0-21swapper/219:57:032
1983343992119,1cyclictest0-21swapper/219:51:012
1983343992119,1cyclictest0-21swapper/219:39:392
1983343992119,1cyclictest0-21swapper/219:27:562
1983343992119,1cyclictest0-21swapper/219:23:232
1983343992119,1cyclictest0-21swapper/219:16:062
1983343992119,1cyclictest0-21swapper/200:01:462
1983343992118,2cyclictest3056-21PK-Backend23:15:292
1983343992114,5cyclictest1984623-21sshd19:10:282
1983343992112,7cyclictest2013-21gdbus00:22:452
198334399210,3cyclictest2098361-21runrttasks00:31:352
198334399210,20cyclictest3056-21PK-Backend23:29:212
198334399210,20cyclictest0-21swapper/222:05:122
198334399210,20cyclictest0-21swapper/221:47:282
198334399210,20cyclictest0-21swapper/221:00:092
198334399210,20cyclictest0-21swapper/219:34:052
1983339992113,6cyclictest883-21dbus-daemon21:57:411
1983339992113,5cyclictest2071002-21grep23:15:201
198333999211,19cyclictest0-21swapper/122:30:291
198333999211,19cyclictest0-21swapper/122:30:291
198333999210,20cyclictest3056-21PK-Backend19:11:501
198333999210,20cyclictest0-21swapper/123:10:041
198333999210,20cyclictest0-21swapper/100:27:511
198333999210,19cyclictest3056-21PK-Backend23:46:141
198333999210,19cyclictest3056-21PK-Backend00:39:341
198333499219,11cyclictest2020671-21cron20:55:000
1983334992120,1cyclictest0-21swapper/021:41:330
1983334992119,1cyclictest3056-21PK-Backend23:10:080
1983334992119,1cyclictest3056-21PK-Backend20:07:230
1983334992119,1cyclictest0-21swapper/023:43:540
1983334992119,1cyclictest0-21swapper/023:37:590
1983334992119,1cyclictest0-21swapper/022:16:200
1983334992119,1cyclictest0-21swapper/022:09:240
1983334992119,1cyclictest0-21swapper/019:37:360
1983334992119,1cyclictest0-21swapper/019:26:540
1983334992115,5cyclictest13-21ksoftirqd/020:00:230
198333499210,20cyclictest0-21swapper/021:26:050
198333499210,20cyclictest0-21swapper/000:15:580
139099210,18rtkit-daemon3194-21gmain19:53:100
20858852200,5sleep12085725-40updatedb.mlocat00:00:011
198334899206,6cyclictest42-21ksoftirqd/323:00:283
1983348992018,1cyclictest3056-21PK-Backend22:52:393
1983348992018,1cyclictest3056-21PK-Backend22:52:393
1983348992018,1cyclictest3056-21PK-Backend21:57:433
1983348992018,1cyclictest0-21swapper/323:44:093
1983348992018,1cyclictest0-21swapper/300:36:213
1983348992017,2cyclictest3056-21PK-Backend23:24:503
1983348992017,2cyclictest3056-21PK-Backend20:41:453
1983348992014,4cyclictest2069483-21python323:10:213
1983348992013,5cyclictest2090484-21awk00:10:193
1983348992012,6cyclictest2047890-21fw_packets22:10:153
198334899201,17cyclictest2028890-21ntp_states21:15:213
198334899200,8cyclictest436-20systemd-journal19:10:283
198334899200,7cyclictest42-21ksoftirqd/320:30:003
198334899200,6cyclictest20858862latency_hist00:00:003
198334899200,1cyclictest3056-21PK-Backend21:47:433
198334899200,19cyclictest3056-21PK-Backend23:16:313
198334899200,19cyclictest3056-21PK-Backend22:59:423
198334899200,19cyclictest3056-21PK-Backend00:29:113
198334899200,19cyclictest0-21swapper/323:53:293
198334899200,19cyclictest0-21swapper/321:41:003
198334899200,19cyclictest0-21swapper/321:07:003
198334899200,19cyclictest0-21swapper/320:51:053
198334899200,19cyclictest0-21swapper/320:09:553
198334899200,19cyclictest0-21swapper/319:53:263
1983343992019,1cyclictest0-21swapper/223:41:382
1983343992018,1cyclictest0-21swapper/222:44:192
1983343992018,1cyclictest0-21swapper/222:13:302
1983343992018,1cyclictest0-21swapper/222:00:462
1983343992018,1cyclictest0-21swapper/221:51:542
1983343992018,1cyclictest0-21swapper/221:51:542
1983343992018,1cyclictest0-21swapper/221:25:382
1983343992018,1cyclictest0-21swapper/220:39:412
1983343992018,1cyclictest0-21swapper/220:32:332
1983343992018,1cyclictest0-21swapper/200:07:332
1983343992017,2cyclictest3056-21PK-Backend22:27:302
1983343992013,5cyclictest2062553-21python322:50:222
1983343992013,5cyclictest2062553-21python322:50:222
1983343992012,7cyclictest883-21dbus-daemon00:30:012
1983343992010,5cyclictest2029701-21ls21:20:012
198334399200,1cyclictest3056-21PK-Backend23:00:012
198334399200,1cyclictest0-21swapper/223:13:062
198334399200,19cyclictest0-21swapper/223:34:422
1983339992018,1cyclictest0-21swapper/123:40:191
1983339992018,1cyclictest0-21swapper/120:28:011
1983339992018,1cyclictest0-21swapper/100:30:141
1983339992017,2cyclictest3056-21PK-Backend23:02:341
1983339992017,2cyclictest3056-21PK-Backend22:20:561
1983339992017,2cyclictest3056-21PK-Backend21:12:221
1983339992017,2cyclictest3056-21PK-Backend00:16:411
1983339992013,5cyclictest2057561-21users22:35:231
198333999200,19cyclictest3056-21PK-Backend19:41:251
198333999200,19cyclictest0-21swapper/122:57:131
198333999200,19cyclictest0-21swapper/119:45:091
198333999200,18cyclictest3056-21PK-Backend23:06:191
198333999200,18cyclictest3056-21PK-Backend21:25:401
1983334992019,1cyclictest0-21swapper/022:42:020
1983334992019,1cyclictest0-21swapper/020:59:420
1983334992018,1cyclictest3056-21PK-Backend19:21:480
1983334992018,1cyclictest0-21swapper/022:31:420
1983334992018,1cyclictest0-21swapper/022:31:410
1983334992018,1cyclictest0-21swapper/022:04:240
1983334992018,1cyclictest0-21swapper/021:56:200
1983334992018,1cyclictest0-21swapper/020:10:410
1983334992018,1cyclictest0-21swapper/019:13:560
1983334992017,2cyclictest3056-21PK-Backend21:53:490
1983334992017,2cyclictest3056-21PK-Backend21:53:490
1983334992013,5cyclictest2071851-21systemd-run23:20:000
1983334992010,9cyclictest2085728-40mandb00:00:010
198333499200,19cyclictest0-21swapper/022:58:380
198333499200,19cyclictest0-21swapper/022:47:300
198333499200,19cyclictest0-21swapper/021:02:460
198333499200,19cyclictest0-21swapper/020:21:220
198333499200,18cyclictest0-21swapper/000:27:540
139099200,3rtkit-daemon1389-21rtkit-daemon20:15:311
139099200,17rtkit-daemon1788643-21eadedCompositor21:18:520
198334899194,13cyclictest2081505-21/usr/sbin/munin23:45:213
1983348991917,1cyclictest3056-21PK-Backend22:05:133
1983348991917,1cyclictest3056-21PK-Backend21:00:523
1983348991917,1cyclictest0-21swapper/322:32:453
1983348991917,1cyclictest0-21swapper/322:32:453
1983348991917,1cyclictest0-21swapper/322:20:283
1983348991917,1cyclictest0-21swapper/322:18:323
1983348991917,1cyclictest0-21swapper/319:25:203
1983348991916,2cyclictest3056-21PK-Backend20:17:533
1983348991914,4cyclictest42-21ksoftirqd/323:05:233
1983348991912,5cyclictest2027434-21ls21:10:223
1983348991911,6cyclictest883-21dbus-daemon00:07:443
1983348991911,6cyclictest2054031-21users22:25:233
198334899190,1cyclictest3056-21PK-Backend23:38:153
198334899190,1cyclictest3056-21PK-Backend21:50:133
198334899190,1cyclictest3056-21PK-Backend21:50:133
198334899190,1cyclictest0-21swapper/319:59:283
198334899190,1cyclictest0-21swapper/319:21:353
198334899190,18cyclictest0-21swapper/319:46:163
1983343991917,1cyclictest0-21swapper/221:58:502
1983343991917,1cyclictest0-21swapper/221:05:102
1983343991917,1cyclictest0-21swapper/220:45:022
1983343991917,1cyclictest0-21swapper/220:15:082
1983343991911,6cyclictest2084664-21cat23:55:162
1983343991911,6cyclictest2036147-21cat21:35:242
198334399190,1cyclictest0-21swapper/221:30:242
1983339991917,1cyclictest3056-21PK-Backend21:41:421
1983339991917,1cyclictest3056-21PK-Backend21:36:561
1983339991917,1cyclictest0-21swapper/123:25:181
1983339991917,1cyclictest0-21swapper/122:01:301
1983339991917,1cyclictest0-21swapper/120:12:271
1983339991916,2cyclictest3056-21PK-Backend21:06:141
1983339991912,5cyclictest1988330-21cut19:20:211
198333999191,13cyclictest1095-21runrttasks00:00:041
198333999190,1cyclictest3056-21PK-Backend23:52:221
198333999190,1cyclictest3056-21PK-Backend23:32:011
198333999190,1cyclictest3056-21PK-Backend22:11:301
198333999190,1cyclictest3056-21PK-Backend20:52:141
198333999190,1cyclictest3056-21PK-Backend19:56:451
198333999190,1cyclictest3056-21PK-Backend19:51:311
198333999190,1cyclictest0-21swapper/121:32:431
198333999190,18cyclictest3056-21PK-Backend00:21:291
1983334991918,1cyclictest0-21swapper/022:22:430
1983334991917,1cyclictest0-21swapper/021:32:340
1983334991913,4cyclictest1-21systemd22:27:280
198333499190,1cyclictest0-21swapper/023:31:170
198333499190,1cyclictest0-21swapper/023:03:110
198333499190,1cyclictest0-21swapper/020:30:210
198333499190,1cyclictest0-21swapper/000:31:060
198333499190,18cyclictest0-21swapper/019:30:390
1983348991816,1cyclictest3056-21PK-Backend20:33:413
1983348991816,1cyclictest3056-21PK-Backend20:13:133
1983348991816,1cyclictest0-21swapper/320:20:363
1983348991816,1cyclictest0-21swapper/319:19:263
1983348991813,3cyclictest2021214-21apt20:55:123
1983348991812,5cyclictest2060431-21irqstats22:45:183
1983348991811,6cyclictest2031993-21df21:25:133
198334399184,13cyclictest2057945-21cron22:40:012
198334399181,8cyclictest2004569-21awk20:10:002
1983343991816,1cyclictest0-21swapper/222:59:132
1983343991813,3cyclictest2093190-21perf00:20:002
1983343991811,5cyclictest34-21ksoftirqd/222:15:152
198333999188,7cyclictest436-20systemd-journal20:05:001
1983339991816,1cyclictest3056-21PK-Backend22:25:021
1983339991816,1cyclictest3056-21PK-Backend19:15:211
1983339991816,1cyclictest0-21swapper/123:23:431
1983339991816,1cyclictest0-21swapper/119:29:071
1983339991815,2cyclictest3056-21PK-Backend22:15:561
1983339991812,4cyclictest2022681-21munin-plugin-st21:00:001
1983339991811,6cyclictest2016664-21sed20:40:231
1983339991811,5cyclictest2058315-21ls22:40:131
198333999180,1cyclictest3056-21PK-Backend21:04:181
1983334991816,1cyclictest0-21swapper/022:11:200
1983334991816,1cyclictest0-21swapper/020:44:480
1983334991812,5cyclictest2010013-21apt-get20:25:040
198334899172,13cyclictest42-21ksoftirqd/320:00:113
1983348991715,1cyclictest0-21swapper/323:33:083
198334399178,7cyclictest883-21dbus-daemon00:39:592
1983343991712,3cyclictest2077728-21if_enp2s023:35:172
198334399170,15cyclictest1995379-21cat19:40:372
1983339991715,1cyclictest3056-21PK-Backend22:46:181
1983339991714,2cyclictest3056-21PK-Backend00:11:561
1983339991712,3cyclictest1992669-21acpi19:35:111
1983334991716,1cyclictest0-21swapper/019:16:060
1983334991715,1cyclictest0-21swapper/020:15:210
1983334991715,1cyclictest0-21swapper/000:14:230
1983334991713,3cyclictest2039174-21missed_timers21:45:190
198333499171,14cyclictest2031357-21apt21:25:000
139099170,13rtkit-daemon1994818-21diskstats19:40:280
20189682160,4sleep00-21swapper/020:50:010
1983348991613,2cyclictest3056-21PK-Backend23:26:253
198334399168,6cyclictest2056223-21apt-get22:35:012
198334399168,6cyclictest2056223-21apt-get22:35:012
1983343991614,1cyclictest0-21swapper/220:57:052
1983343991611,3cyclictest2015951-21cstates20:40:132
1983339991614,1cyclictest0-21swapper/120:21:121
1983339991614,1cyclictest0-21swapper/119:30:421
198333499169,5cyclictest436-20systemd-journal00:24:280
1983334991614,1cyclictest0-21swapper/022:35:130
198334899153,4cyclictest0-21swapper/320:45:193
198333999158,5cyclictest2015472-21cron20:40:001
1983348991410,3cyclictest42-21ksoftirqd/300:00:163
198333999149,4cyclictest3056-21PK-Backend21:21:461
1983339991411,2cyclictest2087949-21/usr/sbin/munin00:05:201
198333999138,4cyclictest2156-21gnome-shell21:15:091
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional