You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-29 - 17:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackcslot7s.osadl.org (updated Fri May 29, 2026 12:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
300835621440,3sleep2899-21polkitd11:49:412
301662821210,1sleep30-21swapper/311:55:133
294934021180,3sleep126-21ksoftirqd/109:20:031
29981122980,3sleep10-21swapper/111:35:211
139099790,64rtkit-daemon0-21swapper/307:05:283
291241926748,14sleep10-21swapper/107:05:271
291275326444,14sleep20-21swapper/207:09:462
291257726140,14sleep00-21swapper/007:07:300
29546352500,3sleep2331rcuc/209:35:002
29816942490,2sleep30-21swapper/310:50:123
291291799342,17cyclictest2941311-21python308:55:203
2912917993416,6cyclictest913-21gdbus11:50:493
291291799341,4cyclictest899-21polkitd11:49:313
2912917993113,6cyclictest2975762-21/usr/sbin/munin10:34:593
139099270,15rtkit-daemon0-21swapper/208:32:542
29776772250,5chrt0-21swapper/210:40:012
29776772250,5chrt0-21swapper/210:40:002
2912910992521,3cyclictest13-21ksoftirqd/011:48:530
2912915992413,8cyclictest883-21dbus-daemon11:50:122
139099240,16rtkit-daemon3056-21PK-Backend09:12:513
139099240,16rtkit-daemon3056-21PK-Backend07:31:233
2912915992312,9cyclictest34-21ksoftirqd/209:20:012
2912910992321,1cyclictest0-21swapper/009:26:590
139099230,15rtkit-daemon3056-21PK-Backend08:35:313
139099230,14rtkit-daemon0-21swapper/311:35:153
29264532220,3sleep2331rcuc/208:00:222
291291799226,14cyclictest2992027-21cpuspeed_turbos11:20:123
291291799220,20cyclictest2990885-21ntpq11:15:173
2912915992220,1cyclictest0-21swapper/211:36:402
2912915992220,1cyclictest0-21swapper/211:29:362
2912915992220,1cyclictest0-21swapper/208:24:222
2912915992219,2cyclictest0-21swapper/208:28:552
2912915992216,4cyclictest436-20systemd-journal09:54:562
291291599220,21cyclictest0-21swapper/209:04:172
2912912992216,4cyclictest26-21ksoftirqd/111:49:351
291291299221,3cyclictest3014634-21lsb_release11:50:391
2912910992220,1cyclictest0-21swapper/012:32:210
2912910992220,1cyclictest0-21swapper/012:09:430
2912910992220,1cyclictest0-21swapper/009:03:540
2912910992220,1cyclictest0-21swapper/008:56:580
2912910992220,1cyclictest0-21swapper/008:11:230
2912910992220,1cyclictest0-21swapper/007:16:410
2912910992218,2cyclictest2946790-21sshd09:11:050
139099220,15rtkit-daemon3056-21PK-Backend08:00:063
139099220,15rtkit-daemon3056-21PK-Backend07:42:433
2912917992119,1cyclictest3056-21PK-Backend10:09:143
2912917992119,1cyclictest3056-21PK-Backend07:45:233
2912917992119,1cyclictest0-21swapper/310:41:513
2912917992119,1cyclictest0-21swapper/310:26:093
291291799210,20cyclictest0-21swapper/309:50:473
291291799210,20cyclictest0-21swapper/307:12:093
291291799210,19cyclictest3056-21PK-Backend12:17:433
291291799210,19cyclictest3056-21PK-Backend10:21:093
291291799210,19cyclictest3056-21PK-Backend10:16:093
291291599218,12cyclictest2952606-21systemd09:30:012
2912915992119,1cyclictest0-21swapper/211:58:152
2912915992119,1cyclictest0-21swapper/210:57:592
2912915992119,1cyclictest0-21swapper/210:23:122
2912915992119,1cyclictest0-21swapper/210:06:552
2912915992119,1cyclictest0-21swapper/210:03:032
2912915992119,1cyclictest0-21swapper/209:46:352
2912915992119,1cyclictest0-21swapper/208:56:332
2912915992119,1cyclictest0-21swapper/208:37:462
2912915992119,1cyclictest0-21swapper/207:48:252
2912915992119,1cyclictest0-21swapper/207:30:342
2912915992119,1cyclictest0-21swapper/207:20:202
2912915992114,5cyclictest2993333-21grep11:24:592
291291599210,20cyclictest0-21swapper/211:07:332
291291599210,19cyclictest3056-21PK-Backend07:40:002
291291599210,19cyclictest0-21swapper/212:21:002
291291299210,20cyclictest3056-21PK-Backend08:53:091
291291299210,1cyclictest3056-21PK-Backend11:04:291
291291299210,1cyclictest3056-21PK-Backend10:51:531
291291299210,1cyclictest0-21swapper/107:34:421
291291299210,19cyclictest3056-21PK-Backend10:39:491
291291299210,19cyclictest3056-21PK-Backend10:39:491
2912910992119,1cyclictest0-21swapper/012:11:050
2912910992119,1cyclictest0-21swapper/011:44:560
2912910992119,1cyclictest0-21swapper/011:27:330
2912910992119,1cyclictest0-21swapper/011:11:090
2912910992119,1cyclictest0-21swapper/011:07:040
2912910992119,1cyclictest0-21swapper/010:52:510
2912910992119,1cyclictest0-21swapper/010:48:450
2912910992119,1cyclictest0-21swapper/010:30:410
2912910992119,1cyclictest0-21swapper/010:21:340
2912910992119,1cyclictest0-21swapper/010:15:460
2912910992119,1cyclictest0-21swapper/010:14:260
2912910992119,1cyclictest0-21swapper/009:59:310
2912910992119,1cyclictest0-21swapper/009:54:240
2912910992119,1cyclictest0-21swapper/009:47:550
2912910992119,1cyclictest0-21swapper/008:39:490
2912910992119,1cyclictest0-21swapper/008:34:070
2912910992119,1cyclictest0-21swapper/008:15:490
2912910992119,1cyclictest0-21swapper/007:42:230
2912910992113,6cyclictest883-21dbus-daemon11:50:030
2912910992113,6cyclictest2947684-21expr09:15:120
291291099210,20cyclictest3056-21PK-Backend10:25:260
291291099210,20cyclictest0-21swapper/012:27:550
291291099210,20cyclictest0-21swapper/012:19:370
291291099210,20cyclictest0-21swapper/009:06:180
139099210,15rtkit-daemon3056-21PK-Backend07:26:443
2912917992018,1cyclictest3056-21PK-Backend10:00:003
2912917992018,1cyclictest3056-21PK-Backend07:24:273
2912917992018,1cyclictest0-21swapper/311:01:533
2912917992018,1cyclictest0-21swapper/309:41:363
2912917992018,1cyclictest0-21swapper/309:39:253
2912917992018,1cyclictest0-21swapper/309:39:253
2912917992018,1cyclictest0-21swapper/309:26:003
2912917992017,2cyclictest0-21swapper/308:25:163
2912917992015,3cyclictest2976420-21hddtemp_smartct10:35:163
2912917992015,3cyclictest2976420-21hddtemp_smartct10:35:153
2912917992011,7cyclictest2996816-21cron11:34:593
291291799200,1cyclictest0-21swapper/311:06:313
291291799200,19cyclictest3056-21PK-Backend12:09:593
291291799200,19cyclictest3056-21PK-Backend07:16:363
291291799200,19cyclictest0-21swapper/311:42:553
291291799200,19cyclictest0-21swapper/310:49:483
291291799200,19cyclictest0-21swapper/308:45:523
291291799200,19cyclictest0-21swapper/308:15:173
291291599205,5cyclictest34-21ksoftirqd/207:39:592
2912915992018,1cyclictest0-21swapper/212:26:482
2912915992018,1cyclictest0-21swapper/210:41:032
2912915992018,1cyclictest0-21swapper/210:17:242
2912915992018,1cyclictest0-21swapper/207:55:292
2912915992018,1cyclictest0-21swapper/207:27:102
2912915992013,5cyclictest2940012-21sshd08:53:062
291291599200,1cyclictest0-21swapper/212:06:132
291291599200,1cyclictest0-21swapper/210:30:212
291291599200,19cyclictest0-21swapper/212:18:162
291291599200,19cyclictest0-21swapper/211:00:432
291291599200,19cyclictest0-21swapper/210:27:032
291291599200,19cyclictest0-21swapper/209:36:342
291291599200,19cyclictest0-21swapper/209:36:342
291291599200,19cyclictest0-21swapper/207:16:282
2912912992018,1cyclictest0-21swapper/112:05:331
2912912992018,1cyclictest0-21swapper/111:27:271
2912912992018,1cyclictest0-21swapper/108:42:071
2912912992018,1cyclictest0-21swapper/108:10:301
2912912992018,1cyclictest0-21swapper/108:09:301
2912912992018,1cyclictest0-21swapper/107:29:401
2912912992017,2cyclictest3056-21PK-Backend11:15:591
2912912992014,5cyclictest3025935-21needreboot12:20:161
2912912992012,6cyclictest436-20systemd-journal12:33:461
291291299200,1cyclictest3056-21PK-Backend10:30:431
291291299200,19cyclictest3056-21PK-Backend12:28:111
291291299200,19cyclictest3056-21PK-Backend10:41:101
291291299200,19cyclictest3056-21PK-Backend09:40:341
291291299200,19cyclictest0-21swapper/110:16:371
291291299200,19cyclictest0-21swapper/109:13:571
291291299200,19cyclictest0-21swapper/109:03:031
291291299200,19cyclictest0-21swapper/108:45:041
291291299200,19cyclictest0-21swapper/108:16:321
291291299200,19cyclictest0-21swapper/107:55:091
291291299200,19cyclictest0-21swapper/107:53:201
291291299200,18cyclictest2399-21gdbus08:28:041
2912910992018,1cyclictest0-21swapper/012:36:470
2912910992018,1cyclictest0-21swapper/012:02:330
2912910992018,1cyclictest0-21swapper/011:59:150
2912910992018,1cyclictest0-21swapper/011:20:430
2912910992018,1cyclictest0-21swapper/010:02:160
2912910992018,1cyclictest0-21swapper/009:42:150
2912910992018,1cyclictest0-21swapper/009:33:490
2912910992018,1cyclictest0-21swapper/008:26:020
2912910992018,1cyclictest0-21swapper/007:53:240
2912910992018,1cyclictest0-21swapper/007:38:590
2912910992017,2cyclictest0-21swapper/008:40:370
291291099200,4cyclictest2917452-21munin-run07:25:010
291291099200,19cyclictest3056-21PK-Backend11:01:360
291291099200,19cyclictest0-21swapper/008:51:370
291291099200,19cyclictest0-21swapper/008:20:070
291291099200,19cyclictest0-21swapper/008:00:270
291291099200,19cyclictest0-21swapper/007:56:010
291291099200,19cyclictest0-21swapper/007:30:330
139099200,14rtkit-daemon3056-21PK-Backend08:12:253
139099200,14rtkit-daemon0-21swapper/308:23:023
29369452190,4chrt3056-21PK-Backend08:45:020
2912917991917,1cyclictest3056-21PK-Backend12:35:473
2912917991917,1cyclictest3056-21PK-Backend12:33:173
2912917991917,1cyclictest3056-21PK-Backend10:11:103
2912917991913,4cyclictest2959729-21sshd09:46:163
291291799190,1cyclictest0-21swapper/312:27:443
291291799190,18cyclictest0-21swapper/311:10:373
2912915991917,1cyclictest0-21swapper/212:30:412
2912915991917,1cyclictest0-21swapper/212:02:562
2912915991917,1cyclictest0-21swapper/211:40:102
2912915991917,1cyclictest0-21swapper/211:31:462
2912915991917,1cyclictest0-21swapper/209:56:482
2912915991917,1cyclictest0-21swapper/208:47:272
2912915991917,1cyclictest0-21swapper/208:08:122
2912915991917,1cyclictest0-21swapper/207:53:402
2912915991917,1cyclictest0-21swapper/207:11:002
2912915991910,7cyclictest883-21dbus-daemon09:43:332
291291599190,18cyclictest0-21swapper/209:08:152
2912912991917,1cyclictest3056-21PK-Backend10:28:481
2912912991917,1cyclictest3056-21PK-Backend08:57:411
2912912991917,1cyclictest0-21swapper/110:06:571
2912912991917,1cyclictest0-21swapper/109:56:161
2912912991917,1cyclictest0-21swapper/109:05:261
2912912991917,1cyclictest0-21swapper/108:31:201
2912912991917,1cyclictest0-21swapper/107:37:191
2912912991913,4cyclictest26-21ksoftirqd/112:35:161
2912912991912,5cyclictest2954262-21sshd09:34:381
2912912991912,5cyclictest2948838-21cron09:20:001
2912912991912,5cyclictest2914927-21cat07:15:021
291291299190,1cyclictest3056-21PK-Backend10:45:511
291291299190,1cyclictest3056-21PK-Backend09:48:591
291291299190,1cyclictest0-21swapper/112:17:571
291291299190,1cyclictest0-21swapper/108:35:381
291291299190,18cyclictest3056-21PK-Backend07:12:111
291291299190,18cyclictest0-21swapper/111:56:271
291291299190,18cyclictest0-21swapper/110:23:001
291291099195,13cyclictest2918088-21perf07:30:000
2912910991917,1cyclictest0-21swapper/012:22:560
2912910991917,1cyclictest0-21swapper/010:40:010
2912910991917,1cyclictest0-21swapper/010:40:000
2912910991917,1cyclictest0-21swapper/008:05:560
291291099190,1cyclictest0-21swapper/007:12:020
291291099190,18cyclictest3056-21PK-Backend09:36:340
291291099190,18cyclictest3056-21PK-Backend09:36:330
291291099190,18cyclictest0-21swapper/010:43:180
291291099190,18cyclictest0-21swapper/007:50:000
2912917991816,1cyclictest3056-21PK-Backend12:21:013
2912917991816,1cyclictest3056-21PK-Backend09:08:563
2912917991816,1cyclictest3056-21PK-Backend07:54:223
2912917991814,3cyclictest29505512sleep309:21:313
2912917991813,3cyclictest2983214-21apt10:55:133
2912917991810,6cyclictest2936608-21mktemp08:45:013
2912917991810,6cyclictest1020-21ntpd11:25:183
291291799180,1cyclictest3056-21PK-Backend08:33:553
291291799180,17cyclictest3056-21PK-Backend09:31:143
2912915991816,1cyclictest0-21swapper/212:13:362
2912915991816,1cyclictest0-21swapper/210:45:082
2912915991816,1cyclictest0-21swapper/210:12:092
2912915991816,1cyclictest0-21swapper/209:24:382
2912915991816,1cyclictest0-21swapper/208:11:032
2912915991815,2cyclictest2990139-21apt11:15:092
2912915991813,3cyclictest1095-21runrttasks10:50:112
2912915991811,5cyclictest3031249-21sshd12:35:162
2912912991816,1cyclictest3056-21PK-Backend11:13:151
2912912991811,5cyclictest436-20systemd-journal11:34:591
2912912991810,6cyclictest3022184-21df12:10:121
291291299180,1cyclictest0-21swapper/112:04:111
291291299180,1cyclictest0-21swapper/109:28:031
2912910991816,1cyclictest0-21swapper/011:15:150
2912910991813,4cyclictest13-21ksoftirqd/009:20:130
2912910991811,5cyclictest2965722-21expr10:05:140
2912917991715,1cyclictest3056-21PK-Backend12:03:023
2912917991715,1cyclictest3056-21PK-Backend09:15:543
2912917991715,1cyclictest3056-21PK-Backend07:58:333
2912917991710,6cyclictest2927995-21awk08:05:173
2912915991713,3cyclictest978-21snmpd08:44:562
291291299179,6cyclictest2967525-21expr10:10:131
291291299179,6cyclictest2920999-21expr07:40:111
291291299179,6cyclictest2916726-21ntp_states07:20:191
291291299177,8cyclictest1983-21gdbus07:48:031
2912912991710,5cyclictest2965434-21ls10:05:021
2912910991715,1cyclictest0-21swapper/010:56:570
291291799168,6cyclictest42-21ksoftirqd/309:05:003
2912917991614,1cyclictest0-21swapper/308:51:463
291291799161,14cyclictest3021699-21apt-config12:10:013
291291599169,5cyclictest2931115-21systemd08:20:002
2912915991612,3cyclictest2988883-21irqstats11:10:152
2912915991611,3cyclictest2945784-21cpuspeed_turbos09:10:122
2912912991614,1cyclictest3056-21PK-Backend11:22:001
2912912991614,1cyclictest0-21swapper/108:21:391
2912912991612,3cyclictest2998790-21/usr/sbin/munin11:40:131
2912912991610,5cyclictest2926410-21sed08:00:211
2912910991610,5cyclictest2997723-21cat11:35:160
2912910991610,5cyclictest2995677-21expr11:30:140
2912917991513,1cyclictest3056-21PK-Backend10:01:563
291291299159,4cyclictest2961852-21latency_hist09:55:001
2912912991513,1cyclictest3056-21PK-Backend10:57:531
2912917991410,3cyclictest3056-21PK-Backend07:36:123
2912912991412,1cyclictest3056-21PK-Backend11:05:171
291291299141,10cyclictest2954306-21apt-get09:35:041
291291299141,10cyclictest2954306-21apt-get09:35:041
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional