You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-03 - 01:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackcslot7s.osadl.org (updated Tue Jun 02, 2026 12:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
104418421210,3sleep00-21swapper/009:20:120
99740928061,13sleep30-21swapper/307:06:133
99747827152,13sleep00-21swapper/007:07:080
99622726242,14sleep20-21swapper/207:05:082
139099620,52rtkit-daemon0-21swapper/107:09:191
11008062450,4sleep20-21swapper/212:00:132
11067332410,3sleep00-21swapper/012:15:220
11067332410,3sleep00-21swapper/012:15:220
10373482360,3sleep30-21swapper/309:00:143
10324662350,2sleep33056-21PK-Backend08:45:223
139099300,4rtkit-daemon1389-21rtkit-daemon08:47:101
997861992914,13cyclictest1034974-21cron08:55:002
10471422290,3sleep20-21swapper/209:30:002
997861992823,3cyclictest1100091-21nm-dispatcher11:59:222
997867992618,6cyclictest998987-21xargs07:10:223
139099260,4rtkit-daemon1389-21rtkit-daemon08:28:151
139099260,4rtkit-daemon1389-21rtkit-daemon08:28:141
10674822260,3sleep2331rcuc/210:25:182
99786799256,6cyclictest1109104-21awk12:25:083
139099250,4rtkit-daemon1389-21rtkit-daemon11:03:100
997861992415,7cyclictest436-20systemd-journal11:30:002
997855992414,4cyclictest13-21ksoftirqd/012:13:450
997855992411,11cyclictest1048881-21unin-run09:35:000
99785599240,5cyclictest1061129-21runrttasks10:08:480
99785599240,3cyclictest1053259-21chrt09:45:180
997867992320,2cyclictest3056-21PK-Backend10:06:373
997867992320,2cyclictest0-21swapper/309:44:133
997857992318,3cyclictest1000659-21hddtemp_smartct07:15:141
997857992317,4cyclictest436-20systemd-journal11:14:541
997857992316,5cyclictest1097524-21/usr/sbin/munin11:50:161
99785799230,21cyclictest1085139-21memory11:15:171
99785799230,21cyclictest1085139-21memory11:15:171
997855992318,3cyclictest1087769-21idleruntime-cro11:25:000
997855992315,6cyclictest1056672-21df09:55:130
997855992314,8cyclictest1013960-21unin-run07:55:000
997867992219,2cyclictest3056-21PK-Backend10:23:483
997867992219,2cyclictest0-21swapper/311:42:503
997867992216,4cyclictest42-21ksoftirqd/309:55:123
997867992214,6cyclictest1036708-21cron09:00:003
997861992220,1cyclictest0-21swapper/211:33:532
997861992220,1cyclictest0-21swapper/211:02:572
997861992220,1cyclictest0-21swapper/209:57:152
997861992220,1cyclictest0-21swapper/209:20:302
997861992220,1cyclictest0-21swapper/209:12:332
997861992220,1cyclictest0-21swapper/209:06:382
997861992216,5cyclictest883-21dbus-daemon12:38:032
997857992214,5cyclictest1021795-21needreboot08:15:171
99785799220,21cyclictest1389-21rtkit-daemon10:40:561
99785799220,20cyclictest1389-21rtkit-daemon10:12:181
997855992220,1cyclictest0-21swapper/011:36:020
997855992220,1cyclictest0-21swapper/010:37:410
997855992220,1cyclictest0-21swapper/009:42:590
997855992218,3cyclictest161rcuc/009:05:020
997855992214,7cyclictest1085331-21/usr/sbin/munin11:15:210
997855992214,7cyclictest1085331-21/usr/sbin/munin11:15:200
997855992213,3cyclictest13-21ksoftirqd/011:10:180
99785599220,3cyclictest1028907-21rt-features08:35:200
997867992119,1cyclictest3056-21PK-Backend09:38:593
997867992119,1cyclictest3056-21PK-Backend08:42:213
997867992119,1cyclictest3056-21PK-Backend07:18:203
997867992119,1cyclictest0-21swapper/312:39:343
997867992119,1cyclictest0-21swapper/311:52:293
997867992119,1cyclictest0-21swapper/311:48:443
997867992119,1cyclictest0-21swapper/307:48:273
997867992118,2cyclictest3056-21PK-Backend12:02:093
997867992118,2cyclictest3056-21PK-Backend11:15:193
997867992118,2cyclictest3056-21PK-Backend11:15:193
997867992118,2cyclictest3056-21PK-Backend10:58:423
997867992118,2cyclictest3056-21PK-Backend10:25:233
997867992118,2cyclictest3056-21PK-Backend08:03:283
997867992118,2cyclictest0-21swapper/309:46:023
99786799210,20cyclictest3056-21PK-Backend12:21:433
99786799210,20cyclictest3056-21PK-Backend11:58:243
99786799210,20cyclictest3056-21PK-Backend08:13:573
99786799210,20cyclictest3056-21PK-Backend07:25:293
99786799210,20cyclictest3056-21PK-Backend07:25:293
99786799210,20cyclictest0-21swapper/312:34:013
99786799210,19cyclictest3056-21PK-Backend10:54:433
99786799210,19cyclictest3056-21PK-Backend10:32:193
997861992119,1cyclictest0-21swapper/211:51:382
997861992119,1cyclictest0-21swapper/210:52:242
997861992119,1cyclictest0-21swapper/210:19:112
997861992119,1cyclictest0-21swapper/209:37:272
997861992119,1cyclictest0-21swapper/208:57:382
997861992119,1cyclictest0-21swapper/207:29:392
997861992119,1cyclictest0-21swapper/207:29:382
997861992119,1cyclictest0-21swapper/207:17:002
99786199210,20cyclictest0-21swapper/212:34:232
99786199210,20cyclictest0-21swapper/211:17:102
99786199210,20cyclictest0-21swapper/211:17:102
99786199210,20cyclictest0-21swapper/211:10:412
99786199210,20cyclictest0-21swapper/208:27:102
99786199210,20cyclictest0-21swapper/208:27:102
99786199210,20cyclictest0-21swapper/208:06:012
99785799213,15cyclictest1019116-21cron08:10:001
997857992118,2cyclictest3056-21PK-Backend11:39:371
99785599215,6cyclictest13-21ksoftirqd/008:50:120
997855992119,1cyclictest0-21swapper/012:06:240
997855992119,1cyclictest0-21swapper/010:27:340
997855992119,1cyclictest0-21swapper/010:11:390
997855992119,1cyclictest0-21swapper/009:54:280
997855992119,1cyclictest0-21swapper/009:08:590
997855992119,1cyclictest0-21swapper/008:56:230
997855992119,1cyclictest0-21swapper/008:05:260
997855992119,1cyclictest0-21swapper/008:02:080
997855992119,1cyclictest0-21swapper/007:36:540
997855992117,3cyclictest1096672-21cron11:50:000
997855992114,6cyclictest13-21ksoftirqd/012:04:240
997855992113,6cyclictest1075-21whoopsie11:59:230
997855992112,7cyclictest1076268-21df_inode10:50:140
99785599210,6cyclictest3056-21PK-Backend09:30:000
99785599210,20cyclictest0-21swapper/011:07:080
99785599210,20cyclictest0-21swapper/010:30:450
99785599210,20cyclictest0-21swapper/008:18:570
99785599210,20cyclictest0-21swapper/008:12:490
997867992018,1cyclictest3056-21PK-Backend11:13:093
997867992018,1cyclictest3056-21PK-Backend10:37:403
997867992018,1cyclictest3056-21PK-Backend09:34:063
997867992018,1cyclictest3056-21PK-Backend09:16:353
997867992018,1cyclictest3056-21PK-Backend09:12:433
997867992018,1cyclictest3056-21PK-Backend09:06:003
997867992017,2cyclictest3056-21PK-Backend08:09:513
997867992011,6cyclictest0-21swapper/311:35:133
99786799200,19cyclictest3056-21PK-Backend12:05:073
99786799200,19cyclictest3056-21PK-Backend08:22:073
99786799200,19cyclictest3056-21PK-Backend08:18:013
99786799200,19cyclictest0-21swapper/311:32:353
99786799200,19cyclictest0-21swapper/311:29:383
99786799200,19cyclictest0-21swapper/310:01:103
99786799200,19cyclictest0-21swapper/308:53:093
99786799200,18cyclictest3056-21PK-Backend11:02:413
997861992018,1cyclictest0-21swapper/211:45:442
997861992018,1cyclictest0-21swapper/211:36:512
997861992018,1cyclictest0-21swapper/210:41:142
997861992018,1cyclictest0-21swapper/210:22:222
997861992018,1cyclictest0-21swapper/210:06:202
997861992018,1cyclictest0-21swapper/209:50:582
997861992018,1cyclictest0-21swapper/208:02:432
997861992018,1cyclictest0-21swapper/207:55:062
997861992012,6cyclictest1008760-21systemctl07:40:002
99786199200,19cyclictest3056-21PK-Backend12:20:312
99786199200,19cyclictest3056-21PK-Backend10:30:202
99786199200,19cyclictest0-21swapper/212:07:262
99786199200,19cyclictest0-21swapper/211:41:582
99786199200,19cyclictest0-21swapper/210:00:532
99786199200,19cyclictest0-21swapper/208:16:432
99786199200,19cyclictest0-21swapper/207:20:122
997857992018,1cyclictest3056-21PK-Backend12:35:201
997857992018,1cyclictest0-21swapper/111:06:401
997857992018,1cyclictest0-21swapper/110:45:091
997857992017,2cyclictest0-21swapper/111:20:241
997857992012,6cyclictest1026909-21memory08:30:171
99785799200,1cyclictest3056-21PK-Backend09:51:011
99785799200,19cyclictest3056-21PK-Backend12:16:551
99785799200,19cyclictest3056-21PK-Backend12:16:551
99785799200,19cyclictest3056-21PK-Backend11:29:381
99785799200,19cyclictest0-21swapper/110:28:531
99785799200,19cyclictest0-21swapper/110:15:011
99785799200,19cyclictest0-21swapper/109:31:481
99785799200,19cyclictest0-21swapper/108:40:511
99785799200,19cyclictest0-21swapper/108:14:151
99785799200,19cyclictest0-21swapper/107:28:191
99785799200,19cyclictest0-21swapper/107:28:191
99785599209,10cyclictest1004403-21tail07:25:170
99785599209,10cyclictest1004403-21tail07:25:170
99785599205,6cyclictest13-21ksoftirqd/010:45:130
997855992018,1cyclictest0-21swapper/012:21:370
997855992018,1cyclictest0-21swapper/011:52:100
997855992018,1cyclictest0-21swapper/010:40:530
997855992018,1cyclictest0-21swapper/007:12:200
997855992015,4cyclictest13-21ksoftirqd/007:24:590
997855992012,6cyclictest1078381-21ntpq10:55:200
99785599200,1cyclictest0-21swapper/012:26:110
99785599200,19cyclictest0-21swapper/009:37:320
99785599200,19cyclictest0-21swapper/009:18:460
99785599200,19cyclictest0-21swapper/008:48:240
99785599200,19cyclictest0-21swapper/008:40:270
10943682200,3sleep00-21swapper/011:40:220
997867991917,1cyclictest3056-21PK-Backend09:25:213
997867991917,1cyclictest0-21swapper/311:23:573
997867991917,1cyclictest0-21swapper/310:45:253
99786799190,1cyclictest3056-21PK-Backend10:43:003
99786799190,1cyclictest3056-21PK-Backend10:16:523
99786799190,1cyclictest3056-21PK-Backend10:11:033
99786799190,1cyclictest3056-21PK-Backend09:23:193
99786799190,1cyclictest3056-21PK-Backend08:32:223
99786799190,1cyclictest0-21swapper/309:51:173
99786799190,18cyclictest0-21swapper/308:39:183
997861991917,1cyclictest0-21swapper/210:45:132
997861991917,1cyclictest0-21swapper/207:41:202
997861991912,6cyclictest1006801-21sshd07:33:272
997861991912,5cyclictest1047691-21expr09:30:132
99786199190,1cyclictest3056-21PK-Backend09:47:202
99786199190,1cyclictest0-21swapper/209:42:542
99786199190,1cyclictest0-21swapper/207:50:482
99786199190,18cyclictest0-21swapper/211:20:092
99786199190,18cyclictest0-21swapper/209:04:352
997857991917,1cyclictest3056-21PK-Backend11:49:511
997857991917,1cyclictest0-21swapper/112:00:191
997857991912,5cyclictest1068828-21sed10:30:011
997857991911,6cyclictest1016031-21cat08:00:131
99785799190,1cyclictest3056-21PK-Backend12:32:571
99785799190,1cyclictest3056-21PK-Backend12:26:491
99785799190,1cyclictest3056-21PK-Backend11:31:461
99785799190,1cyclictest0-21swapper/111:58:441
99785799190,1cyclictest0-21swapper/110:36:381
99785799190,1cyclictest0-21swapper/110:20:221
99785799190,1cyclictest0-21swapper/109:25:531
99785799190,1cyclictest0-21swapper/109:21:001
99785799190,1cyclictest0-21swapper/109:20:001
99785799190,18cyclictest3056-21PK-Backend09:58:041
99785799190,18cyclictest0-21swapper/112:07:021
99785799190,18cyclictest0-21swapper/110:06:101
99785799190,18cyclictest0-21swapper/109:38:451
99785799190,18cyclictest0-21swapper/109:02:281
99785599199,4cyclictest13-21ksoftirqd/010:03:590
99785599198,4cyclictest13-21ksoftirqd/007:55:160
99785599197,3cyclictest13-21ksoftirqd/007:41:320
99785599195,3cyclictest13-21ksoftirqd/012:33:200
997855991917,1cyclictest0-21swapper/011:26:010
997855991917,1cyclictest0-21swapper/009:13:530
997867991816,1cyclictest3056-21PK-Backend07:20:223
997867991816,1cyclictest0-21swapper/307:59:093
997867991813,3cyclictest1013202-21ntp_states07:50:183
997867991811,5cyclictest918-21rs:main3
997867991811,5cyclictest1008067-21sensors_temp07:35:213
997861991816,1cyclictest0-21swapper/212:28:152
997861991816,1cyclictest0-21swapper/211:08:322
997861991816,1cyclictest0-21swapper/208:45:502
997861991812,5cyclictest1019780-21forks08:10:122
997861991811,6cyclictest1043652-21cron09:19:592
997861991811,5cyclictest436-20systemd-journal07:45:282
99785799182,11cyclictest1005478-21apt07:30:121
997857991816,1cyclictest3056-21PK-Backend10:04:201
997857991816,1cyclictest3056-21PK-Backend07:51:041
997857991816,1cyclictest0-21swapper/107:21:091
997857991815,2cyclictest3056-21PK-Backend11:40:251
997857991813,4cyclictest26-21ksoftirqd/110:55:011
997857991813,3cyclictest1103891-21find12:10:101
997857991813,3cyclictest1024321-21sh08:25:001
997857991811,6cyclictest1041487-21sed09:10:231
997857991811,5cyclictest1051752-21cat09:40:221
99785799180,4cyclictest0-21swapper/109:46:181
99785599189,4cyclictest13-21ksoftirqd/008:25:320
99785599189,4cyclictest13-21ksoftirqd/008:25:310
99785599187,5cyclictest13-21ksoftirqd/012:36:130
99785599186,5cyclictest13-21ksoftirqd/007:30:300
99785599186,4cyclictest13-21ksoftirqd/007:49:580
997855991816,1cyclictest0-21swapper/011:31:420
997855991816,1cyclictest0-21swapper/010:17:280
997855991815,2cyclictest1066691-21sh10:25:000
997855991811,5cyclictest2156-21gnome-shell07:17:090
99785599181,12cyclictest1026334-21taskset08:30:120
99786799170,15cyclictest1024951-21cstates08:25:143
99786799170,15cyclictest1024951-21cstates08:25:143
99786199179,6cyclictest436-20systemd-journal08:24:592
997861991715,1cyclictest0-21swapper/210:39:392
997861991713,3cyclictest1106413-21open_inodes12:15:192
997861991713,3cyclictest1106413-21open_inodes12:15:192
99785799179,6cyclictest1078369-21ntp_states10:55:191
997857991715,1cyclictest3056-21PK-Backend08:53:431
997857991712,3cyclictest998990-21timerandwakeup07:10:221
997857991710,6cyclictest1008199-21sed07:35:221
997857991710,5cyclictest1079988-21cat11:00:171
997857991710,5cyclictest1028764-21ntp_kernel_err08:35:181
997857991710,5cyclictest1014939-21ntpq07:55:201
99785599173,7cyclictest13-21ksoftirqd/008:24:040
99786799168,6cyclictest436-20systemd-journal12:15:003
997867991612,2cyclictest1009002-21apt07:40:143
997867991611,3cyclictest1106444-21processes12:15:193
997867991611,3cyclictest1106444-21processes12:15:193
99786799160,15cyclictest1081472-21diskstats11:05:153
99786199169,5cyclictest436-20systemd-journal10:14:272
99786199165,2cyclictest141rcu_preempt12:10:122
997857991613,2cyclictest3056-21PK-Backend07:46:571
997857991610,5cyclictest1038875-21tr09:05:111
99785799160,2cyclictest3056-21PK-Backend08:55:371
99786199159,5cyclictest34-21ksoftirqd/208:35:002
99786199158,5cyclictest1077921-21cat10:55:142
99786199158,5cyclictest1028399-21expr08:35:142
997861991511,3cyclictest999527-21idleruntime-cro07:15:002
997861991511,3cyclictest1029962-21tr08:40:132
997857991513,1cyclictest0-21swapper/112:22:171
997857991410,3cyclictest3056-21PK-Backend07:42:241
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional