You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-25 - 14:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackcslot7s.osadl.org (updated Tue Aug 25, 2026 00:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
210483721380,7sleep234-21ksoftirqd/222:05:002
210612921030,2sleep00-21swapper/022:05:230
204264327539,13sleep00-21swapper/019:06:270
204277527448,17sleep10-21swapper/119:08:091
139099740,61rtkit-daemon0-21swapper/219:07:092
204267626241,14sleep30-21swapper/319:06:543
21551322570,4sleep33056-21PK-Backend00:35:123
20659412430,4sleep33056-21PK-Backend20:10:223
20931272380,3sleep00-21swapper/021:30:150
21490132260,4sleep1251rcuc/100:15:001
20670732250,3sleep20-21swapper/220:15:142
204306599248,4cyclictest34-21ksoftirqd/223:39:132
204306199240,22cyclictest2082091-21taskset20:58:571
2043057992416,6cyclictest436-20systemd-journal00:40:000
2043067992320,2cyclictest3056-21PK-Backend23:57:073
204306199230,3cyclictest2126780-21irqstats23:05:171
204306199230,21cyclictest0-21swapper/122:40:031
204305799231,21cyclictest2108696-21acpi22:15:120
204305799231,21cyclictest2108696-21acpi22:15:110
139099230,15rtkit-daemon0-21swapper/219:51:042
139099230,15rtkit-daemon0-21swapper/200:14:252
20911262220,5sleep00-21swapper/021:25:090
20793112220,7sleep1251rcuc/120:50:141
2043067992220,1cyclictest3056-21PK-Backend19:51:583
2043067992220,1cyclictest0-21swapper/322:45:033
2043067992213,7cyclictest2048676-21cron19:25:003
2043067992213,7cyclictest2048676-21cron19:25:003
204306799221,19cyclictest2122300-21apt-get22:55:033
204306799220,20cyclictest3056-21PK-Backend23:30:043
2043065992215,5cyclictest2091857-21ntp_states21:25:162
204306599220,21cyclictest0-21swapper/220:11:252
204306199222,14cyclictest1095-21runrttasks19:20:121
204306199222,14cyclictest1095-21runrttasks19:20:121
2043061992220,1cyclictest0-21swapper/120:01:451
2043061992220,1cyclictest0-21swapper/100:01:481
2043061992213,8cyclictest2129080-21sed23:10:221
2043057992220,1cyclictest0-21swapper/023:25:340
2043057992220,1cyclictest0-21swapper/021:55:310
2043057992220,1cyclictest0-21swapper/021:53:080
2043057992220,1cyclictest0-21swapper/021:01:030
2043057992215,5cyclictest883-21dbus-daemon23:25:000
2043057992215,5cyclictest883-21dbus-daemon23:24:590
2043057992215,5cyclictest2131217-21cron23:20:000
2043057992213,7cyclictest436-20systemd-journal23:50:000
139099220,15rtkit-daemon0-21swapper/200:32:482
2043067992119,1cyclictest3056-21PK-Backend23:23:293
2043067992119,1cyclictest3056-21PK-Backend23:23:293
2043067992119,1cyclictest3056-21PK-Backend23:16:533
2043067992119,1cyclictest3056-21PK-Backend22:38:273
2043067992119,1cyclictest3056-21PK-Backend22:30:163
2043067992119,1cyclictest3056-21PK-Backend21:53:243
2043067992119,1cyclictest3056-21PK-Backend21:09:593
2043067992119,1cyclictest3056-21PK-Backend20:09:293
2043067992119,1cyclictest3056-21PK-Backend00:32:363
2043067992119,1cyclictest3056-21PK-Backend00:27:363
2043067992119,1cyclictest3056-21PK-Backend00:06:353
2043067992119,1cyclictest0-21swapper/323:04:153
2043067992119,1cyclictest0-21swapper/321:41:423
2043067992118,2cyclictest3056-21PK-Backend23:07:393
2043067992115,4cyclictest2052179-21systemd-run19:35:003
204306799210,20cyclictest3056-21PK-Backend19:12:103
204306799210,19cyclictest3056-21PK-Backend23:45:053
204306799210,19cyclictest3056-21PK-Backend19:56:163
2043065992119,1cyclictest0-21swapper/223:12:472
2043065992119,1cyclictest0-21swapper/222:28:412
2043065992119,1cyclictest0-21swapper/221:57:172
2043065992119,1cyclictest0-21swapper/221:22:432
2043065992119,1cyclictest0-21swapper/221:14:532
2043065992119,1cyclictest0-21swapper/220:21:532
2043065992119,1cyclictest0-21swapper/219:36:582
2043065992119,1cyclictest0-21swapper/200:19:332
204306599210,2cyclictest2114352-21if_enp2s022:30:162
204306599210,20cyclictest3056-21PK-Backend19:17:452
204306599210,20cyclictest0-21swapper/223:58:452
204306599210,20cyclictest0-21swapper/223:53:442
204306599210,20cyclictest0-21swapper/223:40:182
204306599210,20cyclictest0-21swapper/222:40:032
2043061992119,1cyclictest0-21swapper/123:59:111
2043061992119,1cyclictest0-21swapper/123:41:071
2043061992119,1cyclictest0-21swapper/123:36:061
2043061992119,1cyclictest0-21swapper/121:09:451
2043061992119,1cyclictest0-21swapper/120:49:171
2043061992119,1cyclictest0-21swapper/120:22:541
2043061992119,1cyclictest0-21swapper/120:05:301
2043061992119,1cyclictest0-21swapper/100:20:271
2043061992115,4cyclictest2156-21gnome-shell22:55:081
2043061992115,4cyclictest2156-21gnome-shell21:33:091
2043061992114,5cyclictest2146552-21python300:05:251
204306199210,2cyclictest0-21swapper/122:45:161
204306199210,20cyclictest0-21swapper/122:12:171
204306199210,20cyclictest0-21swapper/121:52:371
2043057992119,1cyclictest0-21swapper/022:33:580
2043057992119,1cyclictest0-21swapper/022:04:510
2043057992119,1cyclictest0-21swapper/020:53:320
2043057992119,1cyclictest0-21swapper/020:11:220
2043057992119,1cyclictest0-21swapper/020:07:360
2043057992119,1cyclictest0-21swapper/019:58:440
2043057992119,1cyclictest0-21swapper/019:48:300
2043057992119,1cyclictest0-21swapper/019:42:220
2043057992119,1cyclictest0-21swapper/019:37:490
2043057992119,1cyclictest0-21swapper/019:31:540
2043057992119,1cyclictest0-21swapper/000:06:040
2043057992118,2cyclictest0-21swapper/000:17:540
204305799210,20cyclictest0-21swapper/023:53:120
204305799210,20cyclictest0-21swapper/019:21:060
204305799210,20cyclictest0-21swapper/019:21:050
204305799210,20cyclictest0-21swapper/000:22:050
204305799210,20cyclictest0-21swapper/000:03:270
139099210,14rtkit-daemon0-21swapper/223:25:122
139099210,14rtkit-daemon0-21swapper/222:20:502
139099210,14rtkit-daemon0-21swapper/222:16:352
139099210,14rtkit-daemon0-21swapper/222:16:352
139099210,14rtkit-daemon0-21swapper/219:59:052
139099210,14rtkit-daemon0-21swapper/219:46:532
139099210,14rtkit-daemon0-21swapper/219:30:412
20779122200,4sleep32077185-21/usr/sbin/munin20:45:193
2043067992018,1cyclictest3056-21PK-Backend23:38:163
2043067992018,1cyclictest3056-21PK-Backend23:11:053
2043067992018,1cyclictest3056-21PK-Backend21:16:283
2043067992018,1cyclictest3056-21PK-Backend20:41:263
2043067992018,1cyclictest3056-21PK-Backend20:32:003
2043067992018,1cyclictest3056-21PK-Backend20:27:393
2043067992018,1cyclictest3056-21PK-Backend00:23:233
2043067992018,1cyclictest0-21swapper/322:00:353
2043067992017,2cyclictest3056-21PK-Backend19:49:013
204306799200,1cyclictest3056-21PK-Backend21:37:433
204306799200,1cyclictest3056-21PK-Backend00:10:473
204306799200,19cyclictest3056-21PK-Backend23:42:283
204306799200,19cyclictest3056-21PK-Backend21:02:083
204306799200,19cyclictest3056-21PK-Backend20:52:273
204306799200,19cyclictest0-21swapper/320:56:123
204306799200,19cyclictest0-21swapper/320:38:293
204306799200,19cyclictest0-21swapper/300:00:333
2043065992018,1cyclictest0-21swapper/223:20:122
2043065992018,1cyclictest0-21swapper/223:20:122
2043065992018,1cyclictest0-21swapper/222:58:012
2043065992018,1cyclictest0-21swapper/221:48:462
2043065992018,1cyclictest0-21swapper/221:15:402
2043065992018,1cyclictest0-21swapper/220:42:422
2043065992018,1cyclictest0-21swapper/220:31:192
2043065992018,1cyclictest0-21swapper/220:06:172
2043065992018,1cyclictest0-21swapper/219:10:282
204306599200,19cyclictest0-21swapper/223:49:322
204306599200,19cyclictest0-21swapper/222:51:252
204306599200,19cyclictest0-21swapper/221:54:072
204306599200,19cyclictest0-21swapper/221:41:502
2043061992018,1cyclictest0-21swapper/123:46:191
2043061992018,1cyclictest0-21swapper/123:19:291
2043061992018,1cyclictest0-21swapper/122:27:521
2043061992018,1cyclictest0-21swapper/121:56:361
2043061992018,1cyclictest0-21swapper/121:36:071
2043061992018,1cyclictest0-21swapper/121:00:321
2043061992018,1cyclictest0-21swapper/119:41:361
2043061992018,1cyclictest0-21swapper/119:18:121
2043061992018,1cyclictest0-21swapper/100:16:141
2043061992013,6cyclictest2092642-21sed21:30:011
2043061992012,6cyclictest2132167-21strings23:20:161
2043061992012,6cyclictest2132167-21strings23:20:161
204306199200,1cyclictest0-21swapper/123:30:181
204306199200,19cyclictest0-21swapper/123:53:101
204306199200,19cyclictest0-21swapper/122:51:241
204306199200,19cyclictest0-21swapper/121:48:391
204306199200,19cyclictest0-21swapper/119:46:101
204306199200,19cyclictest0-21swapper/119:31:101
2043057992018,1cyclictest3056-21PK-Backend20:57:180
2043057992018,1cyclictest0-21swapper/023:40:220
2043057992018,1cyclictest0-21swapper/021:40:370
2043057992018,1cyclictest0-21swapper/021:36:390
2043057992018,1cyclictest0-21swapper/021:18:530
2043057992018,1cyclictest0-21swapper/020:21:140
2043057992018,1cyclictest0-21swapper/020:15:550
2043057992018,1cyclictest0-21swapper/000:13:410
204305799200,19cyclictest0-21swapper/022:50:340
204305799200,19cyclictest0-21swapper/020:33:390
204305799200,19cyclictest0-21swapper/020:25:480
204305799200,19cyclictest0-21swapper/019:50:050
204305799200,19cyclictest0-21swapper/019:26:470
204305799200,19cyclictest0-21swapper/019:16:120
139099200,14rtkit-daemon0-21swapper/223:15:112
139099200,14rtkit-daemon0-21swapper/222:11:422
139099200,14rtkit-daemon0-21swapper/219:40:132
139099200,14rtkit-daemon0-21swapper/200:21:062
139099200,14rtkit-daemon0-21swapper/200:05:552
2043067991917,1cyclictest3056-21PK-Backend20:01:243
2043067991917,1cyclictest3056-21PK-Backend00:19:123
2043067991917,1cyclictest0-21swapper/321:55:483
2043067991916,2cyclictest3056-21PK-Backend22:19:403
2043067991916,2cyclictest3056-21PK-Backend22:19:403
204306799190,1cyclictest3056-21PK-Backend21:31:013
204306799190,1cyclictest3056-21PK-Backend21:25:543
204306799190,18cyclictest3056-21PK-Backend20:24:433
2043065991917,1cyclictest0-21swapper/222:07:252
2043065991917,1cyclictest0-21swapper/220:54:182
2043065991917,1cyclictest0-21swapper/219:21:512
2043065991917,1cyclictest0-21swapper/219:21:512
2043065991915,3cyclictest2075236-21systemd20:40:002
2043065991913,5cyclictest2125487-21ls23:00:232
2043065991912,5cyclictest34-21ksoftirqd/200:00:202
204306599190,18cyclictest34-21ksoftirqd/219:26:222
204306599190,18cyclictest0-21swapper/220:03:212
2043061991917,1cyclictest3056-21PK-Backend23:04:301
2043061991917,1cyclictest0-21swapper/122:34:271
2043061991917,1cyclictest0-21swapper/121:40:071
2043061991917,1cyclictest0-21swapper/121:14:031
2043061991917,1cyclictest0-21swapper/120:36:061
2043061991917,1cyclictest0-21swapper/119:53:411
2043061991917,1cyclictest0-21swapper/100:29:401
2043061991912,5cyclictest2135011-21dpkg23:30:011
2043061991912,5cyclictest2090279-21expr21:20:221
204306199190,1cyclictest0-21swapper/119:58:001
204306199190,18cyclictest0-21swapper/122:08:181
2043057991917,1cyclictest0-21swapper/022:11:130
2043057991917,1cyclictest0-21swapper/020:47:380
2043057991917,1cyclictest0-21swapper/020:38:460
2043057991917,1cyclictest0-21swapper/019:11:400
2043057991911,6cyclictest2124330-21unin-run23:00:010
204305799190,1cyclictest0-21swapper/022:46:210
204305799190,1cyclictest0-21swapper/021:49:080
204305799190,1cyclictest0-21swapper/021:08:060
204305799190,18cyclictest0-21swapper/023:05:340
204305799190,18cyclictest0-21swapper/020:03:510
2043067991816,1cyclictest0-21swapper/319:25:083
2043067991814,2cyclictest20680832sleep320:17:483
2043065991816,1cyclictest0-21swapper/222:36:042
2043065991816,1cyclictest0-21swapper/221:31:212
2043065991816,1cyclictest0-21swapper/220:57:152
2043065991816,1cyclictest0-21swapper/220:29:102
204306599180,1cyclictest0-21swapper/221:06:282
204306599180,1cyclictest0-21swapper/221:01:332
204306599180,1cyclictest0-21swapper/220:47:012
204306199188,8cyclictest2053913-21unin-run19:40:011
2043061991816,1cyclictest0-21swapper/122:19:411
2043061991816,1cyclictest0-21swapper/122:19:411
2043061991816,1cyclictest0-21swapper/120:13:001
2043061991816,1cyclictest0-21swapper/119:10:071
2043061991816,1cyclictest0-21swapper/100:36:291
2043061991816,1cyclictest0-21swapper/100:33:521
2043061991814,3cyclictest2073474-21perf20:35:001
2043061991813,3cyclictest2088524-21python321:15:241
2043061991811,6cyclictest2048940-21find19:25:121
2043061991811,5cyclictest2076185-21ntp_kernel_pll_20:40:171
204306199180,17cyclictest0-21swapper/122:24:421
204305799188,9cyclictest2134699-21apt-get23:30:030
2043057991816,1cyclictest0-21swapper/022:24:590
2043057991811,6cyclictest2090353-21sed21:20:210
2043057991811,5cyclictest2129513-21basename23:15:000
204306799178,8cyclictest3056-21PK-Backend22:30:003
2043067991715,1cyclictest3056-21PK-Backend21:21:343
2043067991715,1cyclictest0-21swapper/319:15:213
2043067991712,4cyclictest42-21ksoftirqd/319:35:113
2043067991710,5cyclictest2122615-21latency_hist22:55:013
204306799170,4cyclictest3056-21PK-Backend23:26:343
2043061991712,3cyclictest2103410-21tr22:00:141
204306199170,15cyclictest2067878-21awk20:15:231
2043057991715,1cyclictest0-21swapper/023:55:010
2043057991715,1cyclictest0-21swapper/021:14:350
2043057991715,1cyclictest0-21swapper/000:34:440
2043057991714,2cyclictest0-21swapper/020:40:210
2043057991713,3cyclictest2117098-21cron22:39:590
2043057991712,4cyclictest2118855-21awk22:44:590
2043057991712,3cyclictest886-21NetworkManager00:30:000
2043057991711,4cyclictest2112909-21grep22:25:190
2043067991614,1cyclictest3056-21PK-Backend23:53:433
2043067991614,1cyclictest3056-21PK-Backend21:10:463
2043067991611,3cyclictest2055612-21sh19:45:003
204306599169,5cyclictest2127335-21sed23:05:232
204306599163,11cyclictest2119296-21cut22:45:112
2043065991610,5cyclictest2136106-21awk23:30:212
204306599160,15cyclictest0-21swapper/221:35:412
204306199168,6cyclictest2115746-21cat22:35:111
2043061991610,5cyclictest2070664-21forks20:25:161
204306799158,5cyclictest2105067-21dpkg22:05:023
204306799150,13cyclictest978-21snmpd21:45:203
204306599159,5cyclictest2152511-21sed00:25:242
204305799154,9cyclictest2138427-21latency_hist23:40:000
2043057991511,3cyclictest1-21systemd23:05:000
204306599149,3cyclictest2155066-21cpuspeed_turbos00:35:102
204306799139,3cyclictest3056-21PK-Backend22:13:363
2043067991311,1cyclictest3056-21PK-Backend22:44:143
204306799120,11cyclictest3056-21PK-Backend22:20:263
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional