You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-04 - 05:09

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Sat Jul 04, 2026 00:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
215802521260,2sleep00-21swapper/023:50:120
214310321100,2sleep10-21swapper/123:05:221
216596821020,3sleep10-21swapper/100:10:221
20587112970,7sleep20-21swapper/219:10:012
139099840,73rtkit-daemon0-21swapper/319:07:043
205850727840,14sleep00-21swapper/019:08:020
205837027840,31sleep10-21swapper/119:06:191
21037032550,4sleep33056-21PK-Backend21:15:173
20723842510,4sleep10-21swapper/119:45:161
21244162440,2sleep10-21swapper/122:15:011
20792072430,3sleep00-21swapper/020:05:120
139099390,3rtkit-daemon1389-21rtkit-daemon22:59:212
20613962370,3sleep03056-21PK-Backend19:15:120
205881299368,20cyclictest2127666-21idleruntime-cro22:25:010
21340352350,2sleep00-21swapper/022:40:190
20690182290,3chrt3056-21PK-Backend19:35:170
20690182290,3chrt3056-21PK-Backend19:35:160
2058824992713,12cyclictest2111464-21python321:35:233
20647122260,12sleep342-21ksoftirqd/319:25:013
2058824992315,5cyclictest2159681-21apt23:55:113
2058812992315,6cyclictest13-21ksoftirqd/000:22:380
21085682220,7chrt0-21swapper/021:30:010
21085682220,7chrt0-21swapper/021:30:010
21020252220,4sleep342-21ksoftirqd/321:10:193
20745292220,10sleep03056-21PK-Backend19:50:210
2058824992220,1cyclictest0-21swapper/321:59:273
2058824992219,2cyclictest3056-21PK-Backend22:13:333
2058824992219,2cyclictest3056-21PK-Backend22:09:423
2058824992219,2cyclictest3056-21PK-Backend19:40:033
2058824992218,2cyclictest3056-21PK-Backend00:08:033
205882499220,20cyclictest3056-21PK-Backend23:12:473
205882499220,20cyclictest3056-21PK-Backend23:00:113
205882499220,20cyclictest3056-21PK-Backend22:30:443
205882499220,20cyclictest3056-21PK-Backend21:50:013
205882499220,20cyclictest3056-21PK-Backend20:51:133
205882499220,20cyclictest3056-21PK-Backend20:43:023
205882499220,20cyclictest3056-21PK-Backend19:58:213
2058820992215,5cyclictest2064426-21cron19:25:002
205882099220,21cyclictest0-21swapper/200:36:522
2058816992220,1cyclictest0-21swapper/123:29:291
2058816992213,7cyclictest2120006-21ntp_states22:00:171
205881699220,21cyclictest0-21swapper/121:25:331
2058812992212,7cyclictest883-21dbus-daemon23:37:340
205881299220,21cyclictest0-21swapper/019:55:140
20969282210,3sleep20-21swapper/220:55:192
2058824992119,1cyclictest3056-21PK-Backend23:08:083
2058824992119,1cyclictest3056-21PK-Backend22:01:233
2058824992119,1cyclictest3056-21PK-Backend00:24:273
2058824992119,1cyclictest0-21swapper/319:45:103
2058824992119,1cyclictest0-21swapper/319:35:433
2058824992119,1cyclictest0-21swapper/319:35:423
2058824992118,2cyclictest3056-21PK-Backend23:36:063
2058824992118,2cyclictest3056-21PK-Backend23:30:253
2058824992118,2cyclictest3056-21PK-Backend22:25:443
2058824992118,2cyclictest3056-21PK-Backend00:04:183
2058824992113,5cyclictest2065809-21python319:25:203
205882499210,20cyclictest3056-21PK-Backend23:44:103
205882499210,20cyclictest3056-21PK-Backend20:21:263
205882499210,20cyclictest0-21swapper/300:15:353
205882499210,1cyclictest3056-21PK-Backend22:52:473
205882499210,19cyclictest3056-21PK-Backend23:19:383
205882499210,19cyclictest3056-21PK-Backend20:45:463
205882499210,19cyclictest3056-21PK-Backend20:34:163
205882499210,19cyclictest3056-21PK-Backend00:30:003
205882099219,11cyclictest2108291-21dpkg21:29:592
2058820992116,3cyclictest2091122-21tr20:40:132
2058820992112,7cyclictest2129848-21gpg-connect-age22:30:012
2058820992111,8cyclictest2060713-21users19:15:022
205882099210,20cyclictest0-21swapper/221:18:542
205882099210,1cyclictest3056-21PK-Backend19:51:272
2058816992119,1cyclictest3056-21PK-Backend19:16:021
2058816992119,1cyclictest3056-21PK-Backend19:11:021
2058816992119,1cyclictest0-21swapper/123:38:571
2058816992119,1cyclictest0-21swapper/122:39:081
2058816992119,1cyclictest0-21swapper/122:39:081
2058816992119,1cyclictest0-21swapper/122:32:101
2058816992119,1cyclictest0-21swapper/122:27:441
2058816992119,1cyclictest0-21swapper/122:09:471
2058816992119,1cyclictest0-21swapper/121:47:301
2058816992119,1cyclictest0-21swapper/100:23:231
2058816992119,1cyclictest0-21swapper/100:02:221
2058816992113,6cyclictest436-20systemd-journal00:15:411
2058816992113,6cyclictest2160379-21awk23:55:161
205881699210,19cyclictest3056-21PK-Backend19:33:451
2058812992119,1cyclictest0-21swapper/022:52:040
2058812992119,1cyclictest0-21swapper/019:47:100
2058812992115,4cyclictest2164630-21munin-plugin-st00:10:000
205881299210,20cyclictest0-21swapper/019:12:020
205881299210,19cyclictest3056-21PK-Backend23:55:180
139099210,15rtkit-daemon3056-21PK-Backend21:01:481
139099210,14rtkit-daemon0-21swapper/120:15:091
21160042200,2sleep20-21swapper/221:50:112
205882499207,8cyclictest42-21ksoftirqd/300:25:183
205882499207,8cyclictest42-21ksoftirqd/300:25:173
2058824992018,1cyclictest3056-21PK-Backend22:48:083
2058824992018,1cyclictest3056-21PK-Backend22:21:173
2058824992018,1cyclictest3056-21PK-Backend21:47:303
2058824992018,1cyclictest3056-21PK-Backend21:28:323
2058824992018,1cyclictest3056-21PK-Backend20:25:323
2058824992018,1cyclictest0-21swapper/323:23:573
2058824992018,1cyclictest0-21swapper/319:11:363
205882499200,1cyclictest3056-21PK-Backend20:58:023
205882499200,19cyclictest3056-21PK-Backend19:17:253
205882499200,19cyclictest2058806-21cyclictest20:15:113
205882499200,19cyclictest0-21swapper/323:26:073
205882499200,19cyclictest0-21swapper/322:15:303
205882499200,19cyclictest0-21swapper/321:40:543
205882499200,19cyclictest0-21swapper/321:32:243
205882499200,19cyclictest0-21swapper/321:32:243
205882099209,10cyclictest918-21rs:main2
205882099209,10cyclictest918-21rs:main2
2058820992018,1cyclictest0-21swapper/222:47:552
2058820992018,1cyclictest0-21swapper/222:22:342
2058820992018,1cyclictest0-21swapper/221:46:252
2058820992018,1cyclictest0-21swapper/221:41:452
2058820992018,1cyclictest0-21swapper/220:00:332
2058820992018,1cyclictest0-21swapper/200:28:282
2058820992018,1cyclictest0-21swapper/200:28:282
2058820992017,2cyclictest0-21swapper/220:51:232
2058820992016,2cyclictest2084906-21python320:20:202
2058820992014,4cyclictest2122458-21sh22:10:012
2058820992013,5cyclictest2060162-21sshd19:11:212
2058820992012,6cyclictest2068190-21systemd-run19:35:002
2058820992012,3cyclictest34-21ksoftirqd/219:55:202
205882099200,1cyclictest0-21swapper/220:25:482
205882099200,19cyclictest3056-21PK-Backend22:15:252
205882099200,19cyclictest0-21swapper/223:20:542
205882099200,19cyclictest0-21swapper/223:14:262
205882099200,19cyclictest0-21swapper/222:50:402
205882099200,19cyclictest0-21swapper/222:43:512
205882099200,19cyclictest0-21swapper/219:38:502
205882099200,19cyclictest0-21swapper/219:38:502
205882099200,19cyclictest0-21swapper/200:21:322
205882099200,19cyclictest0-21swapper/200:08:412
2058816992018,1cyclictest0-21swapper/123:16:261
2058816992018,1cyclictest0-21swapper/122:47:051
2058816992018,1cyclictest0-21swapper/121:19:111
2058816992018,1cyclictest0-21swapper/119:51:571
2058816992016,2cyclictest2151474-21ntp_states23:30:181
2058816992012,6cyclictest2158673-21ntp_states23:50:181
205881699200,19cyclictest3056-21PK-Backend21:31:551
205881699200,19cyclictest3056-21PK-Backend21:31:541
205881699200,19cyclictest0-21swapper/122:53:401
205881699200,19cyclictest0-21swapper/122:41:041
205881699200,19cyclictest0-21swapper/121:52:301
205881699200,19cyclictest0-21swapper/120:54:101
205881699200,19cyclictest0-21swapper/120:47:211
205881699200,19cyclictest0-21swapper/120:35:521
205881699200,19cyclictest0-21swapper/120:35:521
205881699200,19cyclictest0-21swapper/119:57:051
205881699200,19cyclictest0-21swapper/119:38:401
205881699200,19cyclictest0-21swapper/119:38:401
205881699200,19cyclictest0-21swapper/119:29:401
205881699200,19cyclictest0-21swapper/100:09:051
2058812992018,1cyclictest0-21swapper/020:32:460
205881299200,1cyclictest0-21swapper/021:27:490
205881299200,1cyclictest0-21swapper/020:25:560
205881299200,1cyclictest0-21swapper/019:28:180
205881299200,19cyclictest3056-21PK-Backend21:40:450
205881299200,19cyclictest3056-21PK-Backend20:16:240
205881299200,19cyclictest0-21swapper/023:45:380
205881299200,19cyclictest0-21swapper/023:31:040
205881299200,19cyclictest0-21swapper/023:21:520
205881299200,19cyclictest0-21swapper/023:08:460
205881299200,19cyclictest0-21swapper/023:04:070
205881299200,19cyclictest0-21swapper/022:28:390
205881299200,19cyclictest0-21swapper/022:15:550
205881299200,19cyclictest0-21swapper/022:06:140
205881299200,19cyclictest0-21swapper/020:49:430
205881299200,19cyclictest0-21swapper/020:10:090
205881299200,19cyclictest0-21swapper/020:01:090
205881299200,19cyclictest0-21swapper/019:34:470
205881299200,19cyclictest0-21swapper/000:28:170
205881299200,19cyclictest0-21swapper/000:28:160
205882499199,9cyclictest2100132-21/usr/sbin/munin21:05:163
2058824991917,1cyclictest3056-21PK-Backend23:51:283
2058824991917,1cyclictest3056-21PK-Backend20:01:173
2058824991917,1cyclictest0-21swapper/321:02:563
2058824991917,1cyclictest0-21swapper/319:51:043
2058824991916,2cyclictest3056-21PK-Backend20:38:233
2058824991916,2cyclictest3056-21PK-Backend20:38:233
205882499190,1cyclictest3056-21PK-Backend22:40:093
205882499190,1cyclictest0-21swapper/322:55:313
205882499190,1cyclictest0-21swapper/300:11:023
2058820991917,1cyclictest0-21swapper/223:49:272
2058820991917,1cyclictest0-21swapper/223:37:382
2058820991917,1cyclictest0-21swapper/223:31:432
2058820991917,1cyclictest0-21swapper/223:27:242
2058820991917,1cyclictest0-21swapper/223:00:132
2058820991917,1cyclictest0-21swapper/222:00:312
2058820991917,1cyclictest0-21swapper/221:09:002
2058820991917,1cyclictest0-21swapper/221:03:182
2058820991917,1cyclictest0-21swapper/220:32:032
2058820991917,1cyclictest0-21swapper/200:17:462
2058820991917,1cyclictest0-21swapper/200:04:082
2058820991914,3cyclictest978-21snmpd19:48:002
2058820991910,7cyclictest2165757-21python300:10:192
205882099190,1cyclictest0-21swapper/223:54:482
205882099190,1cyclictest0-21swapper/200:31:522
205881699199,8cyclictest1-21systemd20:42:301
2058816991917,1cyclictest0-21swapper/123:13:421
2058816991917,1cyclictest0-21swapper/121:21:071
2058816991917,1cyclictest0-21swapper/120:04:561
2058816991917,1cyclictest0-21swapper/100:33:451
2058816991912,5cyclictest2117658-21cut21:55:131
205881699190,1cyclictest3056-21PK-Backend19:42:111
205881699190,1cyclictest0-21swapper/100:26:221
205881699190,1cyclictest0-21swapper/100:26:211
205881699190,18cyclictest3056-21PK-Backend23:22:411
205881699190,18cyclictest0-21swapper/123:46:471
205881699190,18cyclictest0-21swapper/120:28:141
205881299193,14cyclictest2103788-21needreboot21:15:160
2058812991917,1cyclictest3056-21PK-Backend23:11:310
2058812991917,1cyclictest0-21swapper/022:59:280
2058812991917,1cyclictest0-21swapper/022:01:490
2058812991917,1cyclictest0-21swapper/021:46:000
2058812991917,1cyclictest0-21swapper/021:12:340
2058812991917,1cyclictest0-21swapper/000:34:520
2058812991911,6cyclictest2166897-21grep00:15:130
205881299190,1cyclictest3056-21PK-Backend23:40:310
205881299190,1cyclictest3056-21PK-Backend21:06:190
205881299190,1cyclictest0-21swapper/022:30:350
205881299190,1cyclictest0-21swapper/022:10:060
205881299190,1cyclictest0-21swapper/020:36:520
205881299190,1cyclictest0-21swapper/020:36:520
205881299190,1cyclictest0-21swapper/000:03:350
205881299190,18cyclictest0-21swapper/023:28:550
205881299190,18cyclictest0-21swapper/022:47:250
205881299190,18cyclictest0-21swapper/022:37:300
205881299190,18cyclictest0-21swapper/022:37:300
205881299190,18cyclictest0-21swapper/021:23:560
205881299190,17cyclictest2147007-21grep23:20:010
21001312180,4sleep10-21swapper/121:05:161
205882499182,4cyclictest42-21ksoftirqd/323:45:203
2058824991811,5cyclictest2067408-21ntpq19:30:173
2058820991816,1cyclictest3056-21PK-Backend21:20:162
2058820991816,1cyclictest0-21swapper/223:41:222
2058820991816,1cyclictest0-21swapper/223:16:352
2058820991816,1cyclictest0-21swapper/222:26:272
2058820991816,1cyclictest0-21swapper/220:14:382
2058820991816,1cyclictest0-21swapper/219:44:452
2058820991814,3cyclictest978-21snmpd19:28:422
2058820991811,5cyclictest2118036-21cut21:55:182
2058820991810,6cyclictest2102132-21ntpq21:10:212
2058820991810,6cyclictest2079731-21ls20:05:202
205881699189,7cyclictest2139044-21cat22:55:131
205881699182,12cyclictest2140332-21apt23:00:081
2058816991813,3cyclictest2088980-21latency_hist20:35:011
2058816991812,4cyclictest2096315-21expr20:55:121
2058816991811,5cyclictest436-20systemd-journal00:38:411
2058816991811,5cyclictest2126588-21fw_packets22:20:141
2058816991811,5cyclictest2125355-21cat22:15:181
2058816991810,6cyclictest2102861-21/usr/sbin/munin21:15:001
2058816991810,6cyclictest2063728-21pluginstate19:20:191
205881699180,16cyclictest3056-21PK-Backend20:20:511
205881299189,7cyclictest2096556-21df_inode20:55:130
2058812991816,1cyclictest0-21swapper/021:59:530
2058812991816,1cyclictest0-21swapper/019:44:130
2058812991816,1cyclictest0-21swapper/019:23:520
205881299180,9cyclictest2156-21gnome-shell20:42:320
205882499177,3cyclictest42-21ksoftirqd/320:15:013
2058824991715,1cyclictest3056-21PK-Backend22:35:103
2058824991715,1cyclictest3056-21PK-Backend22:35:093
2058824991715,1cyclictest3056-21PK-Backend21:22:093
205882099179,6cyclictest2109770-21sshd21:31:212
205882099179,6cyclictest2109770-21sshd21:31:202
2058820991715,1cyclictest0-21swapper/223:05:412
2058820991715,1cyclictest0-21swapper/220:35:342
2058820991715,1cyclictest0-21swapper/220:35:332
2058820991714,2cyclictest0-21swapper/223:57:592
205882099170,5cyclictest978-21snmpd20:45:342
2058816991715,1cyclictest0-21swapper/123:44:381
2058816991712,3cyclictest2079630-21proc_pri20:05:191
2058812991715,1cyclictest0-21swapper/020:24:350
2058812991711,5cyclictest2098365-21cat21:00:150
2058812991711,4cyclictest2117450-21cut21:55:010
2058812991710,5cyclictest2095178-21ntpq20:50:180
205881299170,10cyclictest2173933-21sort00:35:110
205882499160,4cyclictest2079721-21/usr/sbin/munin20:05:203
2058820991614,1cyclictest0-21swapper/220:15:272
2058820991611,3cyclictest34-21ksoftirqd/221:40:012
2058820991610,5cyclictest2123225-21sed22:10:162
2058816991610,4cyclictest2081857-21seq20:12:501
2058812991614,1cyclictest0-21swapper/021:36:540
2058812991614,1cyclictest0-21swapper/000:11:540
2058816991510,4cyclictest2110769-21expr21:35:121
2058816991510,3cyclictest2113793-21latency_hist21:45:011
205882499140,13cyclictest2175260-21chrt00:39:433
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional