You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-29 - 19:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackcslot7s.osadl.org (updated Mon Jun 29, 2026 12:44:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
371775121260,3sleep00-21swapper/007:35:170
372998821110,4sleep00-21swapper/008:10:170
381954321040,4sleep13056-21PK-Backend12:25:181
139099930,71rtkit-daemon0-21swapper/307:07:343
370717728242,13sleep10-21swapper/107:06:361
370734026545,14sleep20-21swapper/207:08:422
370742026343,14sleep00-21swapper/007:09:430
38053032480,1sleep30-21swapper/311:45:143
38138752470,3sleep30-21swapper/312:10:123
37414952450,4sleep13056-21PK-Backend08:45:121
38069582420,2sleep00-21swapper/011:50:110
38069582420,2sleep00-21swapper/011:50:110
139099400,4rtkit-daemon3056-21PK-Backend07:40:212
139099270,22rtkit-daemon3056-21PK-Backend08:30:110
3707657992616,6cyclictest3729384-21apt08:10:113
139099260,4rtkit-daemon1389-21rtkit-daemon12:04:010
37761082250,4sleep13056-21PK-Backend10:20:221
3707657992412,11cyclictest3718754-21unin-run07:40:013
139099240,4rtkit-daemon1389-21rtkit-daemon09:53:301
3707657992316,6cyclictest3787112-21perf10:55:003
3707657992316,6cyclictest3787112-21perf10:55:003
3707657992313,5cyclictest3768043-21idleruntime-cro10:00:003
370765299230,21cyclictest3753178-21ntp_states09:15:192
139099230,3rtkit-daemon1389-21rtkit-daemon09:56:021
37775852220,2sleep30-21swapper/310:25:193
370765799221,8cyclictest3739751-21/usr/sbin/munin08:40:173
3707657992217,3cyclictest3746105-21python308:55:233
3707657992215,5cyclictest3784218-21expr10:45:143
3707657992215,4cyclictest3722178-21sh07:49:593
3707657992213,7cyclictest436-20systemd-journal09:35:013
3707657992213,6cyclictest436-20systemd-journal07:11:393
3707652992220,1cyclictest0-21swapper/212:28:112
3707652992213,7cyclictest3708784-21ntp_states07:10:202
370765299220,3cyclictest3738628-21memory08:35:182
3707650992220,1cyclictest3056-21PK-Backend08:11:461
3707650992220,1cyclictest3056-21PK-Backend07:41:581
3707650992220,1cyclictest3056-21PK-Backend07:15:421
3707650992220,1cyclictest0-21swapper/111:05:521
3707650992219,2cyclictest3056-21PK-Backend12:39:531
370765099220,3cyclictest3816213-21grep12:15:191
370765099220,20cyclictest3056-21PK-Backend11:28:091
370765099220,20cyclictest3056-21PK-Backend10:18:181
3707644992220,1cyclictest0-21swapper/010:55:520
3707644992220,1cyclictest0-21swapper/009:05:130
3707644992220,1cyclictest0-21swapper/008:44:110
3707644992220,1cyclictest0-21swapper/007:50:590
139099220,4rtkit-daemon1389-21rtkit-daemon11:53:461
139099220,4rtkit-daemon1389-21rtkit-daemon11:53:451
139099220,4rtkit-daemon1389-21rtkit-daemon11:13:581
139099220,4rtkit-daemon1389-21rtkit-daemon08:54:410
139099220,4rtkit-daemon1389-21rtkit-daemon08:54:410
37844892210,4chrt0-21swapper/210:45:172
3707657992117,2cyclictest3802956-21cron11:40:003
3707657992112,7cyclictest3723566-21sshd07:50:403
3707652992118,2cyclictest3770893-21smartctl10:05:212
3707652992114,6cyclictest883-21dbus-daemon12:39:592
370765299210,20cyclictest0-21swapper/208:23:012
3707650992119,1cyclictest3056-21PK-Backend11:42:341
3707650992119,1cyclictest3056-21PK-Backend11:39:521
3707650992119,1cyclictest3056-21PK-Backend11:21:051
3707650992119,1cyclictest3056-21PK-Backend09:09:591
3707650992119,1cyclictest3056-21PK-Backend07:13:051
3707650992118,2cyclictest3056-21PK-Backend11:31:401
370765099210,20cyclictest3056-21PK-Backend08:38:551
370765099210,20cyclictest0-21swapper/112:09:251
370765099210,19cyclictest3056-21PK-Backend11:56:551
370765099210,19cyclictest3056-21PK-Backend09:36:221
370765099210,19cyclictest3056-21PK-Backend09:28:571
370765099210,19cyclictest3056-21PK-Backend09:16:071
370765099210,19cyclictest3056-21PK-Backend08:31:181
370765099210,19cyclictest3056-21PK-Backend07:54:351
370764499219,11cyclictest3771508-21cron10:09:590
3707644992119,1cyclictest0-21swapper/012:24:000
3707644992119,1cyclictest0-21swapper/012:15:280
3707644992119,1cyclictest0-21swapper/010:36:320
3707644992119,1cyclictest0-21swapper/010:18:080
3707644992119,1cyclictest0-21swapper/010:02:530
3707644992119,1cyclictest0-21swapper/009:37:520
3707644992119,1cyclictest0-21swapper/009:26:030
3707644992119,1cyclictest0-21swapper/009:23:260
3707644992119,1cyclictest0-21swapper/007:46:460
3707644992119,1cyclictest0-21swapper/007:29:500
3707644992119,1cyclictest0-21swapper/007:11:170
3707644992113,6cyclictest3803601-21df_inode11:40:130
370764499210,20cyclictest0-21swapper/012:29:000
370764499210,20cyclictest0-21swapper/011:58:520
370764499210,20cyclictest0-21swapper/011:47:440
370764499210,20cyclictest0-21swapper/011:08:300
370764499210,20cyclictest0-21swapper/009:33:250
370764499210,20cyclictest0-21swapper/008:22:490
3707657992018,1cyclictest3056-21PK-Backend11:02:233
3707657992018,1cyclictest0-21swapper/312:30:523
3707657992018,1cyclictest0-21swapper/308:05:213
3707657992018,1cyclictest0-21swapper/307:41:413
3707657992017,2cyclictest0-21swapper/308:20:213
3707657992014,4cyclictest3771948-21cpuspeed_turbos10:10:123
3707657992014,4cyclictest3748092-21python309:00:203
3707657992012,6cyclictest42-21ksoftirqd/312:00:233
3707657992012,6cyclictest3775635-21awk10:20:173
3707657992012,6cyclictest3734590-21grep08:25:123
3707657992012,5cyclictest1095-21runrttasks08:35:163
3707657992011,7cyclictest3795872-21systemd11:20:013
370765799201,16cyclictest0-21swapper/311:20:013
370765799201,15cyclictest2156-21gnome-shell10:05:593
370765799200,1cyclictest3056-21PK-Backend10:57:443
370765799200,19cyclictest3056-21PK-Backend12:19:293
370765799200,19cyclictest3056-21PK-Backend08:00:413
370765799200,19cyclictest0-21swapper/312:37:083
370765799200,19cyclictest0-21swapper/312:26:533
370765799200,19cyclictest0-21swapper/311:53:423
370765799200,19cyclictest0-21swapper/311:53:413
370765799200,19cyclictest0-21swapper/311:42:403
370765799200,19cyclictest0-21swapper/310:34:323
370765799200,19cyclictest0-21swapper/310:17:573
370765799200,19cyclictest0-21swapper/310:04:313
370765799200,19cyclictest0-21swapper/309:42:473
370765799200,19cyclictest0-21swapper/309:10:363
370765799200,19cyclictest0-21swapper/307:25:543
370765799200,19cyclictest0-21swapper/307:19:513
3707652992018,1cyclictest0-21swapper/209:32:512
3707652992018,1cyclictest0-21swapper/208:55:262
3707652992018,1cyclictest0-21swapper/208:08:552
3707652992013,5cyclictest3730833-21cron08:15:002
3707652992012,6cyclictest3750099-21gdbus09:05:562
370765299200,1cyclictest0-21swapper/209:12:422
370765299200,1cyclictest0-21swapper/208:02:332
370765299200,19cyclictest0-21swapper/211:50:472
370765299200,19cyclictest0-21swapper/211:50:472
370765299200,19cyclictest0-21swapper/211:44:102
370765299200,19cyclictest0-21swapper/211:17:202
370765299200,19cyclictest0-21swapper/211:13:352
370765299200,19cyclictest0-21swapper/211:06:592
370765299200,19cyclictest0-21swapper/210:58:152
370765299200,19cyclictest0-21swapper/209:25:472
370765299200,19cyclictest0-21swapper/207:56:032
370765299200,19cyclictest0-21swapper/207:48:342
370765299200,19cyclictest0-21swapper/207:16:152
370765299200,18cyclictest3056-21PK-Backend12:10:342
3707650992018,1cyclictest3056-21PK-Backend10:47:521
3707650992018,1cyclictest3056-21PK-Backend10:42:191
3707650992018,1cyclictest3056-21PK-Backend09:12:021
3707650992018,1cyclictest3056-21PK-Backend08:56:261
3707650992018,1cyclictest0-21swapper/110:58:271
3707650992018,1cyclictest0-21swapper/110:10:421
3707650992018,1cyclictest0-21swapper/109:49:201
3707650992017,2cyclictest3056-21PK-Backend10:06:371
3707650992017,2cyclictest3056-21PK-Backend09:24:521
3707650992017,2cyclictest3056-21PK-Backend08:52:001
3707650992017,2cyclictest3056-21PK-Backend08:52:001
3707650992013,5cyclictest3748096-21python309:00:191
370765099200,19cyclictest0-21swapper/112:11:271
370765099200,19cyclictest0-21swapper/111:01:121
370765099200,19cyclictest0-21swapper/107:57:051
370765099200,18cyclictest3056-21PK-Backend11:15:101
370765099200,18cyclictest3056-21PK-Backend08:18:421
3707644992018,1cyclictest0-21swapper/010:29:500
3707644992018,1cyclictest0-21swapper/009:53:480
3707644992018,1cyclictest0-21swapper/008:36:410
3707644992018,1cyclictest0-21swapper/007:15:230
3707644992016,2cyclictest37797992sleep010:30:240
370764499200,19cyclictest0-21swapper/012:37:460
370764499200,19cyclictest0-21swapper/011:30:130
370764499200,19cyclictest0-21swapper/011:11:480
370764499200,19cyclictest0-21swapper/010:53:220
370764499200,19cyclictest0-21swapper/010:53:220
370764499200,19cyclictest0-21swapper/009:55:510
370764499200,19cyclictest0-21swapper/009:45:160
370764499200,19cyclictest0-21swapper/009:17:180
370764499200,19cyclictest0-21swapper/008:15:520
370764499200,19cyclictest0-21swapper/008:09:300
370764499200,19cyclictest0-21swapper/007:34:570
37625272190,4chrt34-21ksoftirqd/209:44:382
370765799198,8cyclictest883-21dbus-daemon11:30:003
3707657991917,1cyclictest0-21swapper/311:34:283
3707657991917,1cyclictest0-21swapper/311:10:563
3707657991917,1cyclictest0-21swapper/309:37:473
3707657991917,1cyclictest0-21swapper/309:15:163
3707657991911,6cyclictest42-21ksoftirqd/308:50:133
3707657991911,6cyclictest42-21ksoftirqd/308:50:133
3707657991911,6cyclictest3742964-21cron08:49:593
370765799190,1cyclictest0-21swapper/311:05:413
370765799190,1cyclictest0-21swapper/310:43:513
370765799190,16cyclictest3754232-21sort09:20:133
3707652991917,1cyclictest3056-21PK-Backend09:55:082
3707652991917,1cyclictest0-21swapper/212:32:102
3707652991917,1cyclictest0-21swapper/212:18:322
3707652991917,1cyclictest0-21swapper/211:02:192
3707652991917,1cyclictest0-21swapper/210:44:562
3707652991917,1cyclictest0-21swapper/210:26:042
3707652991917,1cyclictest0-21swapper/209:20:332
3707652991917,1cyclictest0-21swapper/208:40:392
3707652991917,1cyclictest0-21swapper/208:25:172
3707652991914,4cyclictest3713451-21cron07:24:592
3707652991912,6cyclictest3723311-21sensors_temp07:50:182
3707652991912,5cyclictest34-21ksoftirqd/210:00:142
3707652991911,6cyclictest3746705-21apt-get09:00:022
3707652991911,6cyclictest3742264-21awk08:45:192
370765299190,1cyclictest0-21swapper/211:59:522
370765299190,1cyclictest0-21swapper/211:23:162
370765299190,1cyclictest0-21swapper/210:52:272
370765299190,1cyclictest0-21swapper/210:52:272
370765299190,1cyclictest0-21swapper/210:35:572
370765299190,1cyclictest0-21swapper/208:51:542
370765299190,1cyclictest0-21swapper/208:51:542
370765299190,1cyclictest0-21swapper/208:17:002
370765299190,18cyclictest0-21swapper/212:02:082
370765299190,18cyclictest0-21swapper/211:46:542
370765299190,18cyclictest0-21swapper/211:27:352
370765299190,18cyclictest0-21swapper/207:37:392
3707650991917,1cyclictest0-21swapper/108:40:251
3707650991916,2cyclictest3056-21PK-Backend12:22:031
3707650991916,2cyclictest3056-21PK-Backend09:42:511
370765099190,1cyclictest3056-21PK-Backend10:33:461
370765099190,1cyclictest3056-21PK-Backend09:31:551
370765099190,1cyclictest3056-21PK-Backend08:29:021
370765099190,1cyclictest3056-21PK-Backend07:35:281
370765099190,1cyclictest3056-21PK-Backend07:23:331
370765099190,18cyclictest0-21swapper/112:01:141
370765099190,18cyclictest0-21swapper/111:47:141
3707644991917,1cyclictest0-21swapper/011:03:160
3707644991917,1cyclictest0-21swapper/008:48:030
3707644991916,2cyclictest0-21swapper/007:40:170
370764499190,1cyclictest0-21swapper/012:34:010
370764499190,1cyclictest0-21swapper/011:18:510
370764499190,1cyclictest0-21swapper/010:20:110
370764499190,1cyclictest0-21swapper/008:00:120
139099190,17rtkit-daemon931-21wpa_supplicant09:43:310
37635732180,1sleep20-21swapper/209:45:162
370765799182,12cyclictest3763102-21apt09:45:103
3707657991816,1cyclictest0-21swapper/308:30:223
3707657991814,3cyclictest3749338-21diskstats09:05:143
3707657991812,4cyclictest3818556-21sh12:25:003
3707657991811,6cyclictest3780804-21df10:35:133
3707657991811,5cyclictest42-21ksoftirqd/308:15:193
370765799181,15cyclictest3724365-21cpuspeed_turbos07:55:133
3707652991816,1cyclictest3056-21PK-Backend12:05:262
3707652991816,1cyclictest0-21swapper/210:33:212
3707652991816,1cyclictest0-21swapper/210:23:262
3707652991816,1cyclictest0-21swapper/210:10:012
3707652991812,5cyclictest3737582-21sshd08:32:412
3707652991811,5cyclictest3774563-21cat10:15:242
3707652991811,5cyclictest3759853-21irqstats09:35:172
370765099184,12cyclictest3769757-21dump-pmu-power10:04:591
3707650991816,1cyclictest3056-21PK-Backend10:50:231
3707650991816,1cyclictest3056-21PK-Backend10:50:231
3707650991816,1cyclictest3056-21PK-Backend08:24:091
3707650991811,6cyclictest3725895-21find08:00:101
3707644991816,1cyclictest0-21swapper/011:21:480
3707644991815,2cyclictest3056-21PK-Backend11:35:070
3707644991812,4cyclictest1095-21runrttasks12:05:190
3707644991811,5cyclictest3783142-21cat10:40:240
370764499180,1cyclictest3056-21PK-Backend09:10:140
370764499180,1cyclictest0-21swapper/007:22:400
3707657991712,3cyclictest3809175-21ntp_states11:55:183
3707657991711,4cyclictest3812083-21tr12:05:133
370765799170,3cyclictest3756282-21diskstats09:25:143
370765799170,15cyclictest3712899-21switchtime07:20:233
3707652991715,1cyclictest0-21swapper/212:22:242
3707652991715,1cyclictest0-21swapper/209:51:012
3707652991715,1cyclictest0-21swapper/207:25:282
3707650991715,1cyclictest3056-21PK-Backend10:36:581
3707650991715,1cyclictest3056-21PK-Backend07:46:101
3707650991715,1cyclictest0-21swapper/108:08:331
3707650991714,2cyclictest3056-21PK-Backend10:25:351
3707650991711,5cyclictest3714175-21awk07:25:121
370764499179,6cyclictest3724425-21cat07:55:130
370764499172,11cyclictest3813633-21apt12:10:100
3707644991715,1cyclictest0-21swapper/010:12:340
370764499170,14cyclictest3736060-21turbostat08:30:010
370765799169,5cyclictest3716032-21cat07:30:193
3707657991614,1cyclictest3056-21PK-Backend09:53:233
370765299169,5cyclictest3801602-21cat11:35:132
3707652991611,3cyclictest978-21snmpd11:32:222
3707652991610,4cyclictest3717011-21cat07:35:012
370764499169,5cyclictest3746705-21apt-get09:00:000
139099160,14rtkit-daemon0-21swapper/011:25:390
370765099158,5cyclictest3715736-21expr07:30:141
3707644991513,1cyclictest3056-21PK-Backend10:46:060
139099150,12rtkit-daemon3056-21PK-Backend09:00:350
3707650991410,3cyclictest3056-21PK-Backend12:34:431
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional