You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-30 - 16:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackcslot7s.osadl.org (updated Thu Apr 30, 2026 12:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
33094862980,4sleep00-21swapper/009:00:120
33856852960,2sleep00-21swapper/012:00:220
33814982820,3sleep20-21swapper/211:50:122
139099800,70rtkit-daemon0-21swapper/107:07:031
326977727844,9sleep30-21swapper/307:09:093
326980927051,14sleep00-21swapper/007:09:340
326981626543,14sleep20-21swapper/207:09:412
33193842460,4sleep13056-21PK-Backend09:30:001
33750612420,2sleep30-21swapper/311:30:213
3269990994036,3cyclictest34-21ksoftirqd/210:05:282
33070282390,3sleep13056-21PK-Backend08:55:001
33874772380,2sleep00-21swapper/012:05:180
3269990993430,3cyclictest34-21ksoftirqd/210:04:592
3269986992913,14cyclictest922-21systemd-logind10:05:520
3269989992824,3cyclictest26-21ksoftirqd/110:05:351
3269990992719,6cyclictest3364082-21hddtemp_smartct11:00:162
3269989992718,7cyclictest883-21dbus-daemon10:03:481
139099270,4rtkit-daemon1389-21rtkit-daemon07:38:221
3269992992615,8cyclictest436-20systemd-journal10:55:333
139099260,4rtkit-daemon1389-21rtkit-daemon08:22:480
326999299257,6cyclictest922-21systemd-logind10:04:223
3269992992519,4cyclictest1015-21gdbus10:05:313
326999299241,20cyclictest3316513-21hddtemp_smartct09:20:203
3269990992419,4cyclictest34-21ksoftirqd/210:43:572
3269990992419,4cyclictest34-21ksoftirqd/210:43:562
3269990992418,4cyclictest922-21systemd-logind08:44:592
326998999240,9cyclictest33520432ntpq10:25:181
3269990992317,4cyclictest34-21ksoftirqd/210:57:102
3269990992311,10cyclictest34-21ksoftirqd/209:55:012
3269986992314,7cyclictest883-21dbus-daemon10:03:520
3269992992211,5cyclictest3277997-21cat07:30:153
3269990992220,1cyclictest0-21swapper/212:13:382
3269990992220,1cyclictest0-21swapper/211:25:302
3269990992220,1cyclictest0-21swapper/211:19:572
3269990992220,1cyclictest0-21swapper/210:47:462
3269990992218,3cyclictest34-21ksoftirqd/210:30:012
3269990992215,5cyclictest1-21systemd11:50:012
326999099220,21cyclictest0-21swapper/208:22:132
326999099220,19cyclictest0-21swapper/207:45:082
3269989992220,1cyclictest3056-21PK-Backend07:59:511
3269986992220,1cyclictest0-21swapper/011:26:070
3269986992220,1cyclictest0-21swapper/011:22:490
3269986992220,1cyclictest0-21swapper/010:57:480
139099220,4rtkit-daemon1389-21rtkit-daemon10:14:200
33054652210,11sleep13056-21PK-Backend08:45:181
3269992992114,4cyclictest3315242-21python309:15:213
3269992992114,4cyclictest3271654-21idleruntime-cro07:14:593
3269992992113,6cyclictest3318016-21expr09:25:133
326999299211,16cyclictest3366276-21python311:05:213
326999299210,20cyclictest3056-21PK-Backend09:43:173
326999299210,19cyclictest3279809-21/usr/sbin/munin07:35:143
3269990992119,1cyclictest0-21swapper/212:21:002
3269990992119,1cyclictest0-21swapper/211:44:512
3269990992119,1cyclictest0-21swapper/210:13:042
3269990992119,1cyclictest0-21swapper/209:45:262
3269990992119,1cyclictest0-21swapper/209:26:482
3269990992119,1cyclictest0-21swapper/209:05:192
3269990992119,1cyclictest0-21swapper/208:45:312
3269990992119,1cyclictest0-21swapper/208:28:142
3269990992119,1cyclictest0-21swapper/207:43:332
3269990992119,1cyclictest0-21swapper/207:11:152
3269990992117,3cyclictest34-21ksoftirqd/208:36:182
3269990992116,3cyclictest3279081-21ls07:35:012
3269990992115,4cyclictest2156-21gnome-shell11:06:082
3269990992114,5cyclictest3291669-21sshd08:08:462
326999099210,20cyclictest0-21swapper/210:22:322
326999099210,20cyclictest0-21swapper/208:30:512
326999099210,20cyclictest0-21swapper/208:19:352
3269989992119,1cyclictest3056-21PK-Backend11:23:251
3269989992119,1cyclictest3056-21PK-Backend08:28:581
326998999210,20cyclictest3056-21PK-Backend11:17:161
326998999210,19cyclictest3056-21PK-Backend07:54:311
3269986992119,1cyclictest0-21swapper/012:11:560
3269986992119,1cyclictest0-21swapper/011:59:130
3269986992119,1cyclictest0-21swapper/011:53:520
3269986992119,1cyclictest0-21swapper/011:47:290
3269986992119,1cyclictest0-21swapper/011:10:050
3269986992119,1cyclictest0-21swapper/011:06:000
3269986992119,1cyclictest0-21swapper/010:54:430
3269986992119,1cyclictest0-21swapper/010:49:360
3269986992119,1cyclictest0-21swapper/008:50:340
3269986992119,1cyclictest0-21swapper/008:47:570
3269986992119,1cyclictest0-21swapper/008:33:290
3269986992119,1cyclictest0-21swapper/008:12:280
3269986992119,1cyclictest0-21swapper/007:55:450
3269986992119,1cyclictest0-21swapper/007:42:270
3269986992119,1cyclictest0-21swapper/007:32:120
3269986992119,1cyclictest0-21swapper/007:16:580
3269986992117,3cyclictest0-21swapper/010:35:180
326998699210,7cyclictest3290037-21cron08:04:590
326998699210,1cyclictest3056-21PK-Backend08:40:200
326998699210,1cyclictest0-21swapper/007:49:230
326998699210,19cyclictest3056-21PK-Backend07:51:460
326998699210,19cyclictest0-21swapper/011:40:060
326998699210,19cyclictest0-21swapper/009:10:210
139099210,18rtkit-daemon2637-21gmain09:36:040
139099210,18rtkit-daemon1997-21gvfs-afc-volume09:42:050
139099210,14rtkit-daemon0-21swapper/310:51:143
33939032200,4sleep1251rcuc/112:25:121
326999299206,12cyclictest0-21swapper/308:55:003
3269992992018,1cyclictest3056-21PK-Backend08:59:113
3269992992015,3cyclictest3385319-21memory12:00:173
3269992992014,4cyclictest3391685-21ls12:20:003
3269992992012,6cyclictest3376559-21ntp_states11:35:213
3269992992012,6cyclictest3376559-21ntp_states11:35:213
326999299201,17cyclictest3369743-21python311:15:213
326999299201,16cyclictest3287714-21python307:55:203
326999299200,1cyclictest0-21swapper/310:47:133
326999299200,19cyclictest3056-21PK-Backend09:47:443
326999299200,19cyclictest0-21swapper/311:57:503
326999299200,19cyclictest0-21swapper/310:31:303
326999299200,19cyclictest0-21swapper/310:29:273
326999299200,19cyclictest0-21swapper/309:02:363
326999299200,19cyclictest0-21swapper/307:49:493
326999299200,18cyclictest3396879-21cron12:35:003
3269990992018,1cyclictest3056-21PK-Backend08:55:122
3269990992018,1cyclictest0-21swapper/212:30:262
3269990992018,1cyclictest0-21swapper/211:59:512
3269990992018,1cyclictest0-21swapper/207:15:542
3269990992013,6cyclictest3285210-21expr07:50:122
3269990992013,5cyclictest34-21ksoftirqd/209:15:212
3269990992012,2cyclictest34-21ksoftirqd/212:00:112
3269990992011,7cyclictest2638-21gdbus10:50:592
326999099200,1cyclictest0-21swapper/210:30:562
326999099200,19cyclictest0-21swapper/212:37:372
326999099200,19cyclictest0-21swapper/209:56:292
326999099200,19cyclictest0-21swapper/209:10:452
326999099200,19cyclictest0-21swapper/209:02:282
326999099200,19cyclictest0-21swapper/208:54:092
326999099200,19cyclictest0-21swapper/207:39:002
3269989992018,1cyclictest3056-21PK-Backend11:28:321
3269989992018,1cyclictest3056-21PK-Backend10:12:421
3269989992017,2cyclictest3056-21PK-Backend11:41:511
326998999200,1cyclictest3056-21PK-Backend11:12:091
326998999200,1cyclictest3056-21PK-Backend10:47:561
326998999200,19cyclictest3056-21PK-Backend12:35:101
326998999200,19cyclictest3056-21PK-Backend11:55:571
326998999200,19cyclictest3056-21PK-Backend11:46:441
326998999200,19cyclictest3056-21PK-Backend07:29:091
326998999200,19cyclictest0-21swapper/112:24:091
326998999200,19cyclictest0-21swapper/109:45:101
326998999200,18cyclictest3056-21PK-Backend10:57:431
3269986992018,1cyclictest0-21swapper/011:19:310
3269986992018,1cyclictest0-21swapper/008:59:260
3269986992018,1cyclictest0-21swapper/008:05:170
326998699200,4cyclictest1095-21runrttasks07:11:110
326998699200,19cyclictest0-21swapper/010:19:430
326998699200,19cyclictest0-21swapper/007:36:310
139099200,3rtkit-daemon1389-21rtkit-daemon10:31:330
139099200,3rtkit-daemon1389-21rtkit-daemon09:25:310
139099200,13rtkit-daemon0-21swapper/211:30:432
3269992991917,1cyclictest3056-21PK-Backend12:25:213
3269992991917,1cyclictest0-21swapper/311:50:523
3269992991917,1cyclictest0-21swapper/308:40:583
3269992991917,1cyclictest0-21swapper/307:53:343
3269992991914,3cyclictest3299246-21apt08:30:123
3269992991914,3cyclictest3276252-21diskstats07:25:143
3269992991913,5cyclictest3367789-21/usr/sbin/munin11:10:183
3269992991911,6cyclictest3389538-21awk12:10:223
3269992991911,6cyclictest3372982-21cat11:25:163
326999299191,15cyclictest3378405-21python311:40:183
326999299190,7cyclictest3379655-21ls11:45:123
326999299190,1cyclictest3056-21PK-Backend08:01:043
326999299190,1cyclictest0-21swapper/312:36:573
326999299190,18cyclictest0-21swapper/310:39:153
326999299190,18cyclictest0-21swapper/310:16:373
326999299190,18cyclictest0-21swapper/309:34:253
326999299190,18cyclictest0-21swapper/309:14:513
326999299190,17cyclictest3357384-21python310:40:213
326999299190,17cyclictest3357384-21python310:40:213
326999299190,16cyclictest3311281-21df_inode09:05:133
3269990991917,1cyclictest0-21swapper/211:39:312
3269990991917,1cyclictest0-21swapper/211:39:302
3269990991917,1cyclictest0-21swapper/211:22:142
3269990991917,1cyclictest0-21swapper/209:23:572
3269990991917,1cyclictest0-21swapper/208:12:592
3269990991912,6cyclictest3390914-21ntpq12:15:152
3269990991912,2cyclictest34-21ksoftirqd/208:02:502
326999099190,1cyclictest0-21swapper/211:14:232
326999099190,1cyclictest0-21swapper/209:39:462
326999099190,18cyclictest0-21swapper/209:31:282
326999099190,18cyclictest0-21swapper/207:25:282
3269989991917,1cyclictest3056-21PK-Backend12:12:061
3269989991917,1cyclictest3056-21PK-Backend10:17:341
3269989991917,1cyclictest3056-21PK-Backend09:17:461
3269989991917,1cyclictest3056-21PK-Backend07:43:161
3269989991915,3cyclictest3272411-21apt07:15:111
3269989991912,5cyclictest3308147-21ntp_kernel_err08:55:141
3269989991912,5cyclictest3294972-21cat08:15:211
326998999190,1cyclictest3056-21PK-Backend12:18:001
326998999190,1cyclictest3056-21PK-Backend12:01:031
326998999190,1cyclictest3056-21PK-Backend11:34:411
326998999190,1cyclictest3056-21PK-Backend09:52:531
326998999190,1cyclictest3056-21PK-Backend09:41:321
326998999190,1cyclictest3056-21PK-Backend09:24:481
326998999190,1cyclictest3056-21PK-Backend09:06:171
326998999190,1cyclictest0-21swapper/108:05:271
326998999190,1cyclictest0-21swapper/108:01:281
326998999190,18cyclictest3056-21PK-Backend09:01:501
326998999190,18cyclictest0-21swapper/108:23:581
326998999190,17cyclictest3056-21PK-Backend11:51:511
3269986991917,1cyclictest0-21swapper/012:25:290
3269986991917,1cyclictest0-21swapper/010:25:030
3269986991917,1cyclictest0-21swapper/008:36:060
3269986991914,3cyclictest3275616-21dump-pmu-power07:25:010
3269986991912,5cyclictest436-20systemd-journal12:25:010
326998699190,1cyclictest3056-21PK-Backend11:30:270
326998699190,1cyclictest0-21swapper/012:30:360
326998699190,1cyclictest0-21swapper/011:00:530
326998699190,1cyclictest0-21swapper/009:33:250
326999299189,7cyclictest3297252-21cron08:25:013
326999299183,3cyclictest3371119-21cut11:20:143
326999299183,13cyclictest3281449-21grep07:40:113
3269992991816,1cyclictest0-21swapper/309:53:253
3269992991816,1cyclictest0-21swapper/309:35:263
3269992991816,1cyclictest0-21swapper/308:13:073
3269992991813,3cyclictest3388229-21munin-run12:10:013
3269992991812,4cyclictest436-20systemd-journal08:36:283
3269992991812,4cyclictest42-21ksoftirqd/310:10:133
3269992991810,6cyclictest42-21ksoftirqd/308:10:003
3269992991810,6cyclictest3306291-21/usr/sbin/munin08:50:003
326999299180,17cyclictest0-21swapper/309:59:073
326999299180,16cyclictest3275219-21users07:20:223
3269990991814,3cyclictest34-21ksoftirqd/209:45:002
3269990991811,5cyclictest1-21systemd12:29:592
3269989991816,1cyclictest3056-21PK-Backend09:38:551
3269989991816,1cyclictest3056-21PK-Backend08:33:591
3269989991815,2cyclictest3056-21PK-Backend10:51:011
3269986991816,1cyclictest3056-21PK-Backend10:41:260
3269986991816,1cyclictest3056-21PK-Backend10:41:260
3269986991816,1cyclictest0-21swapper/009:08:310
3269986991814,3cyclictest3325769-21head09:45:170
3269986991812,4cyclictest3327032-21cstates09:50:120
3269992991715,1cyclictest0-21swapper/310:23:333
3269992991715,1cyclictest0-21swapper/307:19:543
326999299171,3cyclictest3364080-21hddtemp_smartct11:00:173
326999299170,5cyclictest3298046-21sed08:25:163
326999099179,6cyclictest3347554-21date10:15:002
3269990991713,3cyclictest3386927-21cstates12:05:122
3269990991710,5cyclictest3274512-21df07:20:122
3269989991715,1cyclictest3056-21PK-Backend12:05:081
3269989991715,1cyclictest3056-21PK-Backend11:02:371
3269989991715,1cyclictest3056-21PK-Backend10:34:181
3269989991715,1cyclictest3056-21PK-Backend09:30:171
3269989991715,1cyclictest3056-21PK-Backend08:14:461
3269989991710,5cyclictest3270364-21grep07:10:091
326998999170,4cyclictest141rcu_preempt07:35:001
326998999170,1cyclictest3056-21PK-Backend07:46:141
326998999170,16cyclictest3056-21PK-Backend09:56:451
326998699179,6cyclictest3376803-21cat11:35:230
326998699179,6cyclictest3376803-21cat11:35:220
3269986991715,1cyclictest0-21swapper/009:59:140
3269992991610,4cyclictest3294532-21kernelversion08:15:163
326999099169,5cyclictest3355313-21sed10:35:152
3269990991610,4cyclictest3286308-21cron07:59:552
326998999169,6cyclictest3304148-21cat08:40:211
3269989991614,1cyclictest3056-21PK-Backend12:30:161
3269989991614,1cyclictest3056-21PK-Backend10:35:191
326998999160,1cyclictest3056-21PK-Backend11:05:261
326998999160,1cyclictest3056-21PK-Backend09:11:311
326998699169,5cyclictest436-20systemd-journal12:36:080
326998699168,6cyclictest3350787-21apt-get10:25:010
326998699162,11cyclictest3390209-21apt12:15:090
3269986991614,1cyclictest0-21swapper/008:26:410
3269986991614,1cyclictest0-21swapper/008:19:510
3269986991612,3cyclictest3316310-21tr09:20:170
3269992991513,1cyclictest3056-21PK-Backend12:20:403
3269989991513,1cyclictest3056-21PK-Backend10:44:041
3269989991513,1cyclictest3056-21PK-Backend10:44:041
3269986991513,1cyclictest0-21swapper/009:16:020
326998999147,5cyclictest883-21dbus-daemon08:40:001
326998999141,5cyclictest141rcu_preempt10:21:291
326998999140,5cyclictest141rcu_preempt11:35:211
326998999140,5cyclictest141rcu_preempt11:35:211
3269986991412,1cyclictest0-21swapper/007:28:410
326998999137,4cyclictest2176-21JS10:27:481
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional