You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-10 - 14:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackcslot7s.osadl.org (updated Wed Jun 10, 2026 00:44:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
114506121280,3sleep20-21swapper/223:55:132
114186221240,3sleep00-21swapper/023:45:170
107846521200,5sleep20-21swapper/220:45:152
11430732830,8sleep2341ksoftirqd/223:50:132
139099770,59rtkit-daemon0-21swapper/019:05:180
104323726545,14sleep30-21swapper/319:07:043
104279626545,14sleep10-21swapper/119:05:251
104210226543,14sleep20-21swapper/219:05:142
11349862580,4sleep13056-21PK-Backend23:25:171
10858012450,9sleep013-21ksoftirqd/021:05:180
10822352440,3sleep10-21swapper/120:55:171
11162722420,3sleep30-21swapper/322:30:223
10770262340,3chrt3056-21PK-Backend20:40:193
139099270,4rtkit-daemon1389-21rtkit-daemon19:41:341
139099260,4rtkit-daemon1389-21rtkit-daemon20:30:211
139099260,4rtkit-daemon1389-21rtkit-daemon00:21:500
1043675992616,8cyclictest883-21dbus-daemon00:00:011
139099250,4rtkit-daemon1389-21rtkit-daemon20:08:500
139099240,3rtkit-daemon1389-21rtkit-daemon20:48:220
1043675992321,1cyclictest0-21swapper/119:18:171
1043675992315,6cyclictest1-21systemd00:25:001
1043672992321,1cyclictest0-21swapper/023:24:120
1043672992316,5cyclictest1059810-21nm-dispatcher19:50:520
1043686992219,2cyclictest3056-21PK-Backend22:03:303
104368699220,20cyclictest3056-21PK-Backend19:10:053
1043682992220,1cyclictest0-21swapper/221:41:122
1043682992220,1cyclictest0-21swapper/219:56:422
1043675992220,1cyclictest3056-21PK-Backend23:05:021
1043675992220,1cyclictest0-21swapper/122:13:391
1043675992220,1cyclictest0-21swapper/120:47:551
1043675992220,1cyclictest0-21swapper/120:35:111
1043675992220,1cyclictest0-21swapper/120:01:311
1043672992220,1cyclictest0-21swapper/022:32:550
1043672992220,1cyclictest0-21swapper/022:06:180
11474562210,3sleep33056-21PK-Backend00:00:203
1043686992119,1cyclictest0-21swapper/322:44:403
1043686992119,1cyclictest0-21swapper/319:55:283
1043686992119,1cyclictest0-21swapper/319:28:233
104368699211,17cyclictest1124740-21python322:55:223
104368699211,17cyclictest1095011-21python321:30:213
104368699210,8cyclictest1091751-21users21:20:213
104368699210,20cyclictest0-21swapper/323:25:093
104368699210,20cyclictest0-21swapper/323:00:423
104368699210,19cyclictest3056-21PK-Backend20:01:553
104368699210,19cyclictest3056-21PK-Backend19:45:203
1043682992114,6cyclictest1125572-21sed23:00:002
1043682992113,5cyclictest436-20systemd-journal23:24:592
104368299210,20cyclictest11425392sleep223:48:212
104368299210,19cyclictest0-21swapper/222:01:412
1043675992119,1cyclictest3056-21PK-Backend22:47:461
1043675992119,1cyclictest3056-21PK-Backend21:33:101
1043675992119,1cyclictest0-21swapper/123:47:561
1043675992119,1cyclictest0-21swapper/122:09:401
1043675992119,1cyclictest0-21swapper/121:46:151
1043675992119,1cyclictest0-21swapper/121:25:401
1043675992119,1cyclictest0-21swapper/100:05:121
104367599210,19cyclictest3056-21PK-Backend23:02:261
104367599210,19cyclictest3056-21PK-Backend22:27:521
1043672992119,1cyclictest0-21swapper/023:28:040
1043672992119,1cyclictest0-21swapper/023:11:330
1043672992119,1cyclictest0-21swapper/023:06:550
1043672992119,1cyclictest0-21swapper/022:38:080
1043672992119,1cyclictest0-21swapper/021:59:080
1043672992119,1cyclictest0-21swapper/021:27:250
1043672992119,1cyclictest0-21swapper/021:20:410
1043672992119,1cyclictest0-21swapper/021:10:280
1043672992119,1cyclictest0-21swapper/020:58:320
1043672992119,1cyclictest0-21swapper/019:43:490
1043672992119,1cyclictest0-21swapper/019:17:330
1043672992118,2cyclictest0-21swapper/000:30:230
104367299210,20cyclictest0-21swapper/023:38:380
104367299210,20cyclictest0-21swapper/023:31:560
104367299210,20cyclictest0-21swapper/022:25:180
104367299210,20cyclictest0-21swapper/022:02:190
104367299210,20cyclictest0-21swapper/021:31:580
104367299210,20cyclictest0-21swapper/019:23:280
104367299210,20cyclictest0-21swapper/000:15:420
11135682200,2sleep2331rcuc/222:25:112
1043686992018,1cyclictest3056-21PK-Backend23:09:073
1043686992018,1cyclictest3056-21PK-Backend22:08:373
1043686992018,1cyclictest3056-21PK-Backend21:58:223
1043686992018,1cyclictest3056-21PK-Backend21:53:163
1043686992018,1cyclictest3056-21PK-Backend21:38:093
1043686992018,1cyclictest3056-21PK-Backend19:35:403
1043686992018,1cyclictest3056-21PK-Backend00:18:563
1043686992018,1cyclictest0-21swapper/322:51:293
1043686992018,1cyclictest0-21swapper/321:03:483
1043686992013,5cyclictest1086963-21sed21:10:013
1043686992012,6cyclictest1093147-21ntp_states21:25:183
1043686992011,4cyclictest1118448-21wc22:40:013
104368699200,2cyclictest141rcu_preempt19:25:003
104368699200,1cyclictest0-21swapper/323:37:193
104368699200,19cyclictest0-21swapper/323:10:093
104368699200,19cyclictest0-21swapper/322:29:403
104368699200,19cyclictest0-21swapper/321:40:183
104368699200,18cyclictest3056-21PK-Backend19:43:313
1043682992018,1cyclictest0-21swapper/223:06:092
1043682992018,1cyclictest0-21swapper/221:15:512
1043682992018,1cyclictest0-21swapper/220:13:322
1043682992018,1cyclictest0-21swapper/220:01:012
1043682992018,1cyclictest0-21swapper/219:19:112
1043682992018,1cyclictest0-21swapper/200:34:022
1043682992018,1cyclictest0-21swapper/200:22:142
1043682992018,1cyclictest0-21swapper/200:01:582
1043682992015,3cyclictest1093079-21grep21:25:182
1043682992013,5cyclictest1134992-21ntpq23:25:182
1043682992012,6cyclictest1082229-21awk20:55:162
1043682992011,7cyclictest1122833-21netstat22:50:172
104368299200,19cyclictest0-21swapper/222:31:412
104368299200,19cyclictest0-21swapper/222:17:492
104368299200,19cyclictest0-21swapper/222:17:492
104368299200,19cyclictest0-21swapper/221:56:542
104368299200,19cyclictest0-21swapper/221:52:552
104368299200,19cyclictest0-21swapper/220:50:022
104368299200,19cyclictest0-21swapper/220:39:552
104368299200,19cyclictest0-21swapper/219:42:222
104368299200,19cyclictest0-21swapper/200:38:562
104368299200,19cyclictest0-21swapper/200:28:092
104368299200,18cyclictest0-21swapper/200:06:052
1043675992018,1cyclictest3056-21PK-Backend22:55:371
1043675992018,1cyclictest3056-21PK-Backend21:13:491
1043675992018,1cyclictest3056-21PK-Backend21:07:211
1043675992017,2cyclictest0-21swapper/119:10:211
1043675992015,3cyclictest26-21ksoftirqd/100:30:011
1043675992015,3cyclictest1097341-21sh21:40:001
1043675992012,6cyclictest1-21systemd22:16:271
1043675992012,6cyclictest1-21systemd22:16:261
1043675992011,7cyclictest883-21dbus-daemon22:55:011
104367599200,1cyclictest0-21swapper/119:58:131
104367599200,19cyclictest3056-21PK-Backend23:38:211
104367599200,19cyclictest3056-21PK-Backend23:12:201
104367599200,19cyclictest3056-21PK-Backend22:42:321
104367599200,19cyclictest3056-21PK-Backend22:39:541
104367599200,19cyclictest3056-21PK-Backend21:21:551
104367599200,19cyclictest3056-21PK-Backend19:27:511
104367599200,19cyclictest0-21swapper/121:02:281
1043672992018,1cyclictest0-21swapper/023:40:400
1043672992018,1cyclictest0-21swapper/022:59:040
1043672992018,1cyclictest0-21swapper/022:53:500
1043672992018,1cyclictest0-21swapper/022:19:160
1043672992018,1cyclictest0-21swapper/022:19:150
1043672992018,1cyclictest0-21swapper/022:12:400
1043672992018,1cyclictest0-21swapper/021:47:250
1043672992018,1cyclictest0-21swapper/021:15:340
1043672992018,1cyclictest0-21swapper/021:02:370
1043672992018,1cyclictest0-21swapper/020:33:310
1043672992018,1cyclictest0-21swapper/020:10:050
1043672992017,2cyclictest0-21swapper/020:43:170
1043672992013,6cyclictest1150741-21memory00:10:180
1043672992012,6cyclictest1145478-21cat23:55:190
1043672992012,6cyclictest1075289-21ntp_states20:35:200
1043672992011,7cyclictest1080414-21grep20:50:170
104367299200,19cyclictest0-21swapper/022:49:230
104367299200,19cyclictest0-21swapper/019:29:090
104367299200,19cyclictest0-21swapper/000:06:440
104368699199,8cyclictest42-21ksoftirqd/322:10:173
1043686991917,1cyclictest3056-21PK-Backend00:12:413
1043686991917,1cyclictest3056-21PK-Backend00:07:143
1043686991917,1cyclictest0-21swapper/323:34:293
1043686991914,3cyclictest1160569-21turbostat.cron00:40:003
1043686991913,5cyclictest1113257-21sed22:25:003
1043686991911,6cyclictest1142212-21sed23:45:213
1043686991910,7cyclictest1090400-21cron21:20:003
104368699190,7cyclictest1132316-21munin-run23:19:593
104368699190,7cyclictest1132316-21munin-run23:19:593
104368699190,1cyclictest3056-21PK-Backend20:58:003
104368699190,1cyclictest3056-21PK-Backend20:17:453
104368699190,17cyclictest3056-21PK-Backend00:27:483
1043682991917,1cyclictest0-21swapper/223:41:382
1043682991917,1cyclictest0-21swapper/223:34:422
1043682991917,1cyclictest0-21swapper/220:27:112
1043682991917,1cyclictest0-21swapper/220:27:112
1043682991917,1cyclictest0-21swapper/219:11:122
1043682991912,5cyclictest1138169-21ls23:35:162
1043682991912,5cyclictest1087381-21expr21:10:122
1043682991912,5cyclictest1077275-21sed20:40:222
1043682991911,6cyclictest1117151-21cat22:35:122
104368299190,1cyclictest0-21swapper/222:08:492
104368299190,1cyclictest0-21swapper/221:48:562
104368299190,1cyclictest0-21swapper/221:36:262
104368299190,1cyclictest0-21swapper/221:34:022
104368299190,1cyclictest0-21swapper/221:06:592
104368299190,18cyclictest0-21swapper/223:18:472
104368299190,18cyclictest0-21swapper/223:18:472
104368299190,18cyclictest0-21swapper/222:23:032
104368299190,18cyclictest0-21swapper/220:20:142
104368299190,18cyclictest0-21swapper/220:16:292
104368299190,18cyclictest0-21swapper/220:08:382
1043675991912,6cyclictest1103289-21awk21:55:171
104367599190,1cyclictest3056-21PK-Backend23:17:131
104367599190,1cyclictest3056-21PK-Backend23:17:131
104367599190,1cyclictest0-21swapper/122:04:061
104367599190,1cyclictest0-21swapper/121:43:511
104367599190,1cyclictest0-21swapper/120:05:501
104367599190,1cyclictest0-21swapper/100:37:371
104367599190,1cyclictest0-21swapper/100:15:131
104367599190,18cyclictest0-21swapper/120:28:011
104367599190,18cyclictest0-21swapper/120:28:011
104367599190,18cyclictest0-21swapper/120:15:571
104367599190,18cyclictest0-21swapper/119:31:431
1043672991917,1cyclictest0-21swapper/023:16:280
1043672991917,1cyclictest0-21swapper/023:16:270
1043672991917,1cyclictest0-21swapper/022:43:220
1043672991917,1cyclictest0-21swapper/022:21:520
1043672991917,1cyclictest0-21swapper/020:22:360
1043672991917,1cyclictest0-21swapper/020:04:310
1043672991917,1cyclictest0-21swapper/019:45:520
1043672991917,1cyclictest0-21swapper/000:29:210
1043672991917,1cyclictest0-21swapper/000:00:490
1043672991912,5cyclictest1097789-21grep21:40:130
1043672991912,5cyclictest1053769-21cat19:35:140
104367299190,1cyclictest0-21swapper/023:01:410
104367299190,1cyclictest0-21swapper/020:27:560
104367299190,1cyclictest0-21swapper/020:27:550
104367299190,1cyclictest0-21swapper/019:12:050
104367299190,18cyclictest0-21swapper/021:37:180
11589782180,2sleep33056-21PK-Backend00:35:013
1043686991816,1cyclictest3056-21PK-Backend23:50:163
1043686991816,1cyclictest3056-21PK-Backend20:34:013
1043686991815,2cyclictest3056-21PK-Backend20:49:563
1043686991815,2cyclictest3056-21PK-Backend20:21:163
1043686991814,2cyclictest10725062sleep320:29:403
1043686991814,2cyclictest10725062sleep320:29:403
1043686991811,5cyclictest1080468-21awk20:50:183
1043682991816,1cyclictest0-21swapper/221:03:262
1043682991813,3cyclictest1091347-21strings21:20:172
1043682991813,3cyclictest1072954-21cpuspeed_turbos20:30:122
1043682991812,5cyclictest1055010-21sed19:40:002
1043682991810,6cyclictest436-20systemd-journal19:35:002
1043682991810,6cyclictest1120686-21cat22:45:132
104368299180,1cyclictest0-21swapper/200:19:102
1043675991816,1cyclictest3056-21PK-Backend21:18:571
1043675991816,1cyclictest0-21swapper/120:11:251
1043675991816,1cyclictest0-21swapper/119:39:271
1043675991816,1cyclictest0-21swapper/100:02:081
1043675991812,5cyclictest26-21ksoftirqd/120:50:121
1043675991812,4cyclictest1095-21runrttasks23:50:231
1043675991811,5cyclictest1048889-21python319:20:221
1043675991810,6cyclictest1059080-21which19:50:151
104367599180,1cyclictest3056-21PK-Backend23:34:291
104367599180,1cyclictest0-21swapper/119:46:091
1043672991816,1cyclictest0-21swapper/023:51:160
1043672991816,1cyclictest0-21swapper/021:50:350
1043672991816,1cyclictest0-21swapper/020:15:530
1043672991815,2cyclictest1159752-21strings00:35:160
1043672991813,3cyclictest1053216-21idleruntime-cro19:35:000
139099170,13rtkit-daemon1317-21systemd00:33:021
1043686991715,1cyclictest3056-21PK-Backend22:15:203
1043686991715,1cyclictest3056-21PK-Backend22:15:203
1043686991715,1cyclictest3056-21PK-Backend19:50:483
1043686991712,4cyclictest1133575-21sed23:20:233
1043686991712,3cyclictest1139465-21acpi23:40:123
1043686991710,5cyclictest918-21rs:main3
104368699170,3cyclictest1088285-21users21:10:223
104368699170,1cyclictest3056-21PK-Backend23:58:083
1043682991715,1cyclictest0-21swapper/223:11:502
1043682991715,1cyclictest0-21swapper/219:23:502
1043682991712,3cyclictest1108450-21cpuspeed_turbos22:10:122
1043675991715,1cyclictest3056-21PK-Backend22:34:421
1043675991715,1cyclictest3056-21PK-Backend22:22:521
1043675991714,2cyclictest3056-21PK-Backend23:22:071
1043675991711,5cyclictest1101315-21cat21:50:121
1043672991712,3cyclictest1060913-21kernelversion19:55:150
1043686991611,3cyclictest3056-21PK-Backend20:35:123
104368299169,6cyclictest2237-21gdbus19:50:522
104368299169,6cyclictest1057138-21cpuspeed_turbos19:45:122
104368299169,5cyclictest1050427-21cut19:25:162
104368299162,13cyclictest1150339-21tr00:10:132
1043682991614,1cyclictest0-21swapper/223:00:552
1043682991611,3cyclictest1118684-21cpu22:40:122
104367599168,6cyclictest1070093-21ntp_states20:20:191
1043675991614,1cyclictest0-21swapper/100:14:111
104368699156,7cyclictest883-21dbus-daemon00:24:593
1043686991513,1cyclictest3056-21PK-Backend20:13:053
104368699150,6cyclictest3056-21PK-Backend19:30:193
104368699150,14cyclictest3056-21PK-Backend20:07:383
104367599158,5cyclictest1076712-21if_enp2s020:40:151
104368699140,1cyclictest3056-21PK-Backend19:17:083
104368699140,13cyclictest3056-21PK-Backend21:46:473
1043675991311,1cyclictest3056-21PK-Backend23:40:251
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional