You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-04 - 05:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackcslot7s.osadl.org (updated Mon May 04, 2026 00:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
114609721110,4sleep30-21swapper/322:30:213
119107221040,3sleep30-21swapper/300:40:013
107529321000,2sleep30-21swapper/319:10:203
107372827852,19sleep30-21swapper/319:06:193
139099750,60rtkit-daemon0-21swapper/119:06:501
107343526642,16sleep20-21swapper/219:05:262
107256626643,13sleep00-21swapper/019:05:110
10952322530,4sleep10-21swapper/120:05:191
11655052420,1sleep11165507-21cat23:25:211
107415699321,4cyclictest1164312-21idleruntime-cro23:25:002
139099270,4rtkit-daemon1389-21rtkit-daemon20:50:172
139099260,4rtkit-daemon1389-21rtkit-daemon23:11:163
11386832260,4sleep01138681-21seq22:10:180
1074156992612,12cyclictest1109804-21unin-run20:50:002
1074159992519,5cyclictest3056-21PK-Backend19:51:023
107414999250,23cyclictest1084325-21proc_pri19:35:210
139099240,3rtkit-daemon1389-21rtkit-daemon23:32:522
139099240,3rtkit-daemon1389-21rtkit-daemon00:19:212
1074159992412,11cyclictest42-21ksoftirqd/321:35:013
1074149992415,7cyclictest436-20systemd-journal19:25:010
107414999240,22cyclictest1086903-21latency_hist19:45:010
139099230,20rtkit-daemon1317-21systemd19:46:282
11808142230,8sleep013-21ksoftirqd/000:10:150
10955652230,5sleep342-21ksoftirqd/320:09:103
1074156992321,1cyclictest0-21swapper/222:59:182
1074149992311,10cyclictest1146744-21unin-run22:35:000
139099220,4rtkit-daemon1389-21rtkit-daemon00:06:203
1074159992212,7cyclictest1078060-21perf19:20:003
107415999220,20cyclictest3056-21PK-Backend22:05:203
107415999220,20cyclictest3056-21PK-Backend22:05:203
1074156992220,1cyclictest0-21swapper/222:39:582
1074156992220,1cyclictest0-21swapper/220:11:482
1074156992220,1cyclictest0-21swapper/219:43:432
1074156992220,1cyclictest0-21swapper/219:17:402
1074156992217,3cyclictest436-20systemd-journal21:14:552
1074156992217,3cyclictest436-20systemd-journal21:14:552
107415699220,2cyclictest1124309-21smartctl21:30:162
107415699220,21cyclictest0-21swapper/222:47:012
107415699220,21cyclictest0-21swapper/219:59:512
107415699220,20cyclictest1188543-21apt-get00:30:512
1074152992220,1cyclictest0-21swapper/122:57:191
107415299220,20cyclictest3056-21PK-Backend20:48:421
1074149992220,1cyclictest0-21swapper/021:21:060
1074149992220,1cyclictest0-21swapper/021:04:160
1074149992220,1cyclictest0-21swapper/019:32:440
1074149992220,1cyclictest0-21swapper/000:03:230
1074149992220,1cyclictest0-21swapper/000:03:230
107414999220,6cyclictest11655072cat23:25:210
139099210,14rtkit-daemon0-21swapper/119:36:521
139099210,14rtkit-daemon0-21swapper/019:12:580
107415999217,12cyclictest42-21ksoftirqd/322:30:013
107415999216,12cyclictest42-21ksoftirqd/322:15:213
1074159992119,1cyclictest3056-21PK-Backend19:41:223
1074159992119,1cyclictest0-21swapper/323:26:453
1074159992119,1cyclictest0-21swapper/323:15:573
1074159992119,1cyclictest0-21swapper/321:12:543
1074159992119,1cyclictest0-21swapper/321:12:543
1074159992119,1cyclictest0-21swapper/321:02:403
1074159992119,1cyclictest0-21swapper/320:55:033
1074159992118,2cyclictest3056-21PK-Backend20:16:373
1074159992118,2cyclictest3056-21PK-Backend19:25:343
1074159992118,1cyclictest3056-21PK-Backend21:45:323
107415999211,5cyclictest1167162-21python323:30:193
107415999210,20cyclictest3056-21PK-Backend22:36:363
107415999210,20cyclictest3056-21PK-Backend20:37:263
107415999210,20cyclictest3056-21PK-Backend20:01:293
107415999210,1cyclictest3056-21PK-Backend22:55:153
107415999210,1cyclictest3056-21PK-Backend22:48:263
107415999210,19cyclictest3056-21PK-Backend20:12:593
107415999210,19cyclictest3056-21PK-Backend19:38:453
107415999210,19cyclictest3056-21PK-Backend19:30:063
1074156992119,1cyclictest3056-21PK-Backend22:20:042
1074156992119,1cyclictest0-21swapper/223:57:042
1074156992119,1cyclictest0-21swapper/223:46:162
1074156992119,1cyclictest0-21swapper/223:11:352
1074156992119,1cyclictest0-21swapper/222:51:272
1074156992119,1cyclictest0-21swapper/222:06:592
1074156992119,1cyclictest0-21swapper/222:06:592
1074156992119,1cyclictest0-21swapper/221:56:452
1074156992119,1cyclictest0-21swapper/221:54:082
1074156992119,1cyclictest0-21swapper/221:19:142
1074156992119,1cyclictest0-21swapper/220:25:062
1074156992119,1cyclictest0-21swapper/219:31:122
1074156992119,1cyclictest0-21swapper/200:07:052
1074156992119,1cyclictest0-21swapper/200:02:042
1074156992119,1cyclictest0-21swapper/200:02:042
1074156992114,6cyclictest1084984-21cron19:40:012
1074156992113,6cyclictest1113228-21cron21:00:002
107415699210,20cyclictest0-21swapper/223:27:372
107415699210,20cyclictest0-21swapper/223:20:002
107415699210,20cyclictest0-21swapper/222:00:102
107415699210,20cyclictest0-21swapper/220:43:312
107415699210,20cyclictest0-21swapper/220:20:542
107415699210,20cyclictest0-21swapper/219:27:002
107415699210,20cyclictest0-21swapper/200:20:162
107415699210,19cyclictest0-21swapper/220:30:062
1074152992119,1cyclictest3056-21PK-Backend23:35:181
1074152992119,1cyclictest0-21swapper/122:54:551
1074152992119,1cyclictest0-21swapper/122:36:441
1074152992119,1cyclictest0-21swapper/119:45:161
1074152992119,1cyclictest0-21swapper/119:24:191
1074152992113,6cyclictest1162300-21cron23:20:001
107415299210,20cyclictest0-21swapper/122:20:421
1074149992119,1cyclictest0-21swapper/023:47:000
1074149992119,1cyclictest0-21swapper/023:42:000
1074149992119,1cyclictest0-21swapper/023:30:240
1074149992119,1cyclictest0-21swapper/022:50:290
1074149992119,1cyclictest0-21swapper/022:41:030
1074149992119,1cyclictest0-21swapper/022:20:350
1074149992119,1cyclictest0-21swapper/022:06:560
1074149992119,1cyclictest0-21swapper/022:06:560
1074149992119,1cyclictest0-21swapper/022:02:430
1074149992119,1cyclictest0-21swapper/021:41:070
1074149992119,1cyclictest0-21swapper/021:32:420
1074149992119,1cyclictest0-21swapper/021:11:060
1074149992119,1cyclictest0-21swapper/021:11:060
1074149992119,1cyclictest0-21swapper/020:31:520
1074149992119,1cyclictest0-21swapper/019:18:240
1074149992118,2cyclictest0-21swapper/020:38:280
1074149992116,3cyclictest1131951-21rt-features21:50:200
1074149992113,6cyclictest436-20systemd-journal20:10:000
107414999210,2cyclictest0-21swapper/019:50:150
107414999210,20cyclictest0-21swapper/023:09:220
107414999210,20cyclictest0-21swapper/023:09:220
107414999210,20cyclictest0-21swapper/019:47:380
107414999210,20cyclictest0-21swapper/000:28:300
10773272200,4sleep13056-21PK-Backend19:15:201
107415999206,12cyclictest42-21ksoftirqd/321:50:213
107415999202,13cyclictest1188821-21unattended-upgr00:30:583
1074159992018,1cyclictest3056-21PK-Backend22:51:023
1074159992018,1cyclictest3056-21PK-Backend20:25:023
1074159992018,1cyclictest0-21swapper/323:54:233
1074159992018,1cyclictest0-21swapper/323:48:343
1074159992018,1cyclictest0-21swapper/323:21:453
1074159992018,1cyclictest0-21swapper/322:20:343
1074159992018,1cyclictest0-21swapper/321:36:203
1074159992018,1cyclictest0-21swapper/300:14:103
1074159992015,3cyclictest978-21snmpd00:15:043
107415999201,16cyclictest978-21snmpd21:20:193
107415999200,1cyclictest3056-21PK-Backend21:41:203
107415999200,19cyclictest3056-21PK-Backend19:59:403
107415999200,19cyclictest3056-21PK-Backend19:45:483
107415999200,19cyclictest0-21swapper/322:00:193
107415999200,19cyclictest0-21swapper/321:06:053
107415999200,19cyclictest0-21swapper/320:44:493
107415999200,19cyclictest0-21swapper/320:33:133
107415999200,19cyclictest0-21swapper/300:22:213
107415999200,19cyclictest0-21swapper/300:00:113
107415999200,19cyclictest0-21swapper/300:00:113
107415699203,15cyclictest1093922-21grep20:04:592
1074156992018,1cyclictest0-21swapper/223:50:282
1074156992018,1cyclictest0-21swapper/221:22:392
1074156992018,1cyclictest0-21swapper/200:13:402
1074156992013,5cyclictest1168592-21sed23:35:182
1074156992012,6cyclictest1115449-21cat21:05:152
107415699200,19cyclictest0-21swapper/222:28:442
107415699200,19cyclictest0-21swapper/221:37:532
107415699200,19cyclictest0-21swapper/221:01:242
107415699200,19cyclictest0-21swapper/219:51:472
107415699200,19cyclictest0-21swapper/219:11:522
1074152992018,1cyclictest0-21swapper/121:57:231
1074152992017,2cyclictest3056-21PK-Backend20:55:591
1074152992013,5cyclictest1086752-21pluginstate19:45:011
1074152992012,6cyclictest883-21dbus-daemon19:35:001
1074152992012,6cyclictest1158236-21python323:05:211
1074152992012,6cyclictest1158236-21python323:05:211
107415299200,19cyclictest0-21swapper/122:29:001
107415299200,19cyclictest0-21swapper/122:14:331
107415299200,18cyclictest3056-21PK-Backend00:27:351
1074149992018,1cyclictest0-21swapper/022:56:310
1074149992018,1cyclictest0-21swapper/022:47:520
1074149992018,1cyclictest0-21swapper/022:28:120
1074149992018,1cyclictest0-21swapper/021:56:550
1074149992018,1cyclictest0-21swapper/021:45:200
1074149992018,1cyclictest0-21swapper/021:27:420
1074149992011,7cyclictest1100011-21df_inode20:20:140
107414999200,9cyclictest10969702cat20:10:220
107414999200,1cyclictest0-21swapper/021:15:180
107414999200,19cyclictest0-21swapper/023:37:470
107414999200,19cyclictest0-21swapper/020:01:440
107414999200,19cyclictest0-21swapper/019:57:190
1074159991917,1cyclictest0-21swapper/321:17:553
1074159991917,1cyclictest0-21swapper/320:51:383
1074159991917,1cyclictest0-21swapper/320:47:263
1074159991912,5cyclictest42-21ksoftirqd/322:40:133
107415999191,17cyclictest1176783-21grep00:00:013
107415999190,18cyclictest0-21swapper/323:08:063
107415999190,18cyclictest0-21swapper/323:08:063
107415999190,17cyclictest1170165-21hddtemp_smartct23:40:163
1074156991917,1cyclictest0-21swapper/220:38:312
1074156991916,2cyclictest1190891-21cron00:40:002
1074156991912,6cyclictest1156946-21sshd23:03:092
107415699190,1cyclictest0-21swapper/222:31:202
107415699190,1cyclictest0-21swapper/222:13:012
107415699190,18cyclictest0-21swapper/223:06:212
107415699190,18cyclictest0-21swapper/223:06:212
1074152991917,1cyclictest3056-21PK-Backend23:14:291
107415299190,1cyclictest0-21swapper/121:40:321
107415299190,1cyclictest0-21swapper/121:24:041
107415299190,1cyclictest0-21swapper/120:19:141
107415299190,1cyclictest0-21swapper/120:04:061
107415299190,1cyclictest0-21swapper/119:53:461
107414999194,13cyclictest1113245-21awk21:00:000
1074149991917,1cyclictest0-21swapper/023:11:110
1074149991917,1cyclictest0-21swapper/021:07:410
107414999190,1cyclictest0-21swapper/021:37:420
107414999190,1cyclictest0-21swapper/020:50:040
107414999190,1cyclictest0-21swapper/020:45:030
11333772180,4sleep33056-21PK-Backend21:55:163
107415999185,2cyclictest141rcu_preempt20:20:203
107415999182,12cyclictest1168041-21apt23:35:133
1074159991816,1cyclictest3056-21PK-Backend22:12:573
1074159991816,1cyclictest0-21swapper/321:28:433
1074159991815,2cyclictest3056-21PK-Backend23:01:173
1074159991815,2cyclictest3056-21PK-Backend19:21:413
1074156991816,1cyclictest0-21swapper/222:41:472
1074156991814,3cyclictest1130825-21cron21:50:002
1074156991810,6cyclictest1078566-21cat19:20:122
1074152991815,1cyclictest3056-21PK-Backend23:55:181
1074152991812,5cyclictest1156907-21seq23:02:381
1074152991811,5cyclictest1180174-21cron00:10:001
1074152991811,5cyclictest1092346-21sed20:00:011
107414999189,7cyclictest1189800-21df00:35:140
107414999189,7cyclictest1147351-21df_inode22:35:150
1074149991816,1cyclictest0-21swapper/023:54:240
1074149991816,1cyclictest0-21swapper/022:17:100
1074149991816,1cyclictest0-21swapper/020:18:400
1074149991814,3cyclictest1176694-21dump-pmu-power00:00:000
1074149991813,3cyclictest1081511-21latency_hist19:30:000
107415999170,15cyclictest1185646-21apt00:25:103
1074156991715,1cyclictest0-21swapper/221:25:152
1074156991715,1cyclictest0-21swapper/220:06:202
107415299179,6cyclictest1100036-21fw_packets20:20:151
1074152991715,1cyclictest3056-21PK-Backend21:02:281
1074152991715,1cyclictest0-21swapper/120:26:311
1074152991714,2cyclictest3056-21PK-Backend00:16:281
1074152991712,3cyclictest1146114-21switchtime22:30:221
1074152991710,5cyclictest1174691-21cron23:55:001
1074152991710,5cyclictest1130294-21cat21:45:211
1074152991710,5cyclictest1096285-21df20:10:141
1074152991710,5cyclictest1081000-21ls19:25:211
1074149991710,5cyclictest883-21dbus-daemon00:30:490
1074149991710,5cyclictest1156016-21seq23:00:130
1074149991710,5cyclictest1101702-21expr20:25:120
107415699169,5cyclictest1185852-21cat00:25:122
107415699168,6cyclictest1099359-21cron20:20:002
1074156991614,1cyclictest0-21swapper/221:43:072
1074156991611,3cyclictest1169981-21cstates23:40:142
107415299168,6cyclictest1131106-21apt21:50:121
1074152991614,1cyclictest3056-21PK-Backend21:25:391
1074152991614,1cyclictest3056-21PK-Backend21:19:451
1074152991614,1cyclictest0-21swapper/121:39:261
1074152991611,3cyclictest11887882chrt00:30:491
1074152991611,3cyclictest1135146-21load22:00:161
1074152991610,5cyclictest1106662-21ls20:40:121
107415299160,15cyclictest886-21NetworkManager22:16:091
107415299160,15cyclictest3056-21PK-Backend00:03:431
107415299160,15cyclictest3056-21PK-Backend00:03:421
1074149991614,1cyclictest0-21swapper/023:19:360
107415299158,5cyclictest1136453-21expr22:05:141
107415299158,5cyclictest1136453-21expr22:05:131
107415299153,2cyclictest141rcu_preempt23:40:201
1074152991513,1cyclictest3056-21PK-Backend23:33:081
1074152991513,1cyclictest0-21swapper/120:38:421
1074152991511,3cyclictest3056-21PK-Backend23:48:301
1074152991511,3cyclictest1150188-21idleruntime-cro22:45:001
1074152991510,3cyclictest1151937-21sh22:50:011
107415299150,14cyclictest3056-21PK-Backend23:24:291
107415299150,14cyclictest3056-21PK-Backend20:53:011
107414999158,5cyclictest1182271-21sort00:15:120
1074149991513,1cyclictest0-21swapper/000:24:320
1074149991510,3cyclictest1163505-21needreboot23:20:170
11236662140,4sleep13056-21PK-Backend21:30:011
1074156991410,3cyclictest1139826-21cpuspeed22:15:112
107415299144,9cyclictest3056-21PK-Backend19:15:001
1074152991412,1cyclictest3056-21PK-Backend00:38:451
1074152991412,1cyclictest3056-21PK-Backend00:14:181
1074152991410,3cyclictest3056-21PK-Backend20:30:011
107415299140,1cyclictest3056-21PK-Backend21:11:071
107415299140,1cyclictest3056-21PK-Backend21:11:061
107414999148,5cyclictest1106875-21expr20:40:120
1074149991410,3cyclictest1180173-21idleruntime-cro00:10:000
11156532130,3sleep1251rcuc/121:05:181
107415299130,1cyclictest3056-21PK-Backend00:22:431
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional