You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-18 - 15:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Sat Jul 18, 2026 12:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
191674822300,8sleep10-21swapper/107:05:201
198515121430,4sleep33056-21PK-Backend10:17:003
139099930,72rtkit-daemon0-21swapper/207:05:132
191606227946,23sleep30-21swapper/307:05:123
191750026444,14sleep00-21swapper/007:09:350
20027032510,3sleep13056-21PK-Backend11:09:541
19239282460,3sleep10-21swapper/107:25:111
139099440,3rtkit-daemon0-21swapper/209:51:462
19510312280,3sleep10-21swapper/108:40:181
20053652270,3chrt0-21swapper/011:15:190
19896132270,2sleep0161rcuc/010:30:160
1917693992517,6cyclictest1970993-21cron09:40:002
1917693992511,12cyclictest1948499-21unin-run08:35:012
1917689992517,5cyclictest1985386-21cron10:19:591
1917695992419,3cyclictest1964692-21df09:20:133
191769599241,16cyclictest1095-21runrttasks11:20:123
19262282230,3sleep33056-21PK-Backend07:30:193
1917695992318,3cyclictest1950203-21sh08:40:013
1917695992314,5cyclictest1961729-21python309:10:243
1917688992315,6cyclictest883-21dbus-daemon07:18:260
191768899230,21cyclictest1983069-21python310:10:220
139099230,15rtkit-daemon3056-21PK-Backend10:43:343
20330322220,2sleep33056-21PK-Backend12:35:143
19634632220,3chrt0-21swapper/309:15:213
19544922220,3sleep30-21swapper/308:50:193
191769399223,17cyclictest1997856-21sort10:55:122
1917693992220,1cyclictest0-21swapper/210:41:472
1917693992220,1cyclictest0-21swapper/210:30:242
1917693992220,1cyclictest0-21swapper/210:15:452
1917693992214,6cyclictest436-20systemd-journal11:55:012
1917689992220,1cyclictest0-21swapper/112:20:151
1917689992220,1cyclictest0-21swapper/110:10:221
191768899220,3cyclictest1984309-21diskstats10:15:150
191768899220,21cyclictest0-21swapper/010:56:320
139099220,15rtkit-daemon3056-21PK-Backend10:01:213
139099220,15rtkit-daemon3056-21PK-Backend08:46:133
20158502210,3sleep13056-21PK-Backend11:45:201
1917695992115,4cyclictest2018326-21sh11:55:003
1917695992115,3cyclictest1977346-21python309:55:213
191769599211,17cyclictest1976230-21cut09:55:013
191769599210,20cyclictest3056-21PK-Backend08:41:193
1917693992119,1cyclictest0-21swapper/212:20:362
1917693992119,1cyclictest0-21swapper/211:45:072
1917693992119,1cyclictest0-21swapper/211:01:132
1917693992119,1cyclictest0-21swapper/210:52:352
1917693992119,1cyclictest0-21swapper/210:26:532
1917693992119,1cyclictest0-21swapper/209:45:352
1917693992119,1cyclictest0-21swapper/209:30:562
1917693992119,1cyclictest0-21swapper/208:26:282
1917693992119,1cyclictest0-21swapper/208:21:472
1917693992119,1cyclictest0-21swapper/207:42:272
1917693992119,1cyclictest0-21swapper/207:17:472
1917693992114,5cyclictest1995952-21wc10:50:012
191769399210,20cyclictest0-21swapper/212:25:422
191769399210,20cyclictest0-21swapper/211:59:532
191769399210,20cyclictest0-21swapper/211:28:102
191769399210,20cyclictest0-21swapper/210:22:002
191769399210,20cyclictest0-21swapper/208:14:242
1917689992119,1cyclictest3056-21PK-Backend10:06:311
1917689992119,1cyclictest0-21swapper/112:07:161
1917689992119,1cyclictest0-21swapper/111:58:381
1917689992119,1cyclictest0-21swapper/111:38:431
1917689992119,1cyclictest0-21swapper/111:17:341
1917689992119,1cyclictest0-21swapper/107:36:371
1917689992119,1cyclictest0-21swapper/107:22:051
1917689992118,2cyclictest3056-21PK-Backend11:40:531
1917689992118,2cyclictest3056-21PK-Backend09:23:241
191768999210,20cyclictest3056-21PK-Backend11:12:071
191768999210,20cyclictest0-21swapper/110:26:321
191768999210,20cyclictest0-21swapper/110:23:481
191768999210,19cyclictest3056-21PK-Backend08:21:131
1917688992119,1cyclictest0-21swapper/012:24:050
1917688992119,1cyclictest0-21swapper/011:46:270
1917688992119,1cyclictest0-21swapper/011:36:140
1917688992119,1cyclictest0-21swapper/011:31:070
1917688992119,1cyclictest0-21swapper/010:39:290
1917688992119,1cyclictest0-21swapper/010:24:140
1917688992119,1cyclictest0-21swapper/010:01:220
1917688992119,1cyclictest0-21swapper/009:35:480
1917688992119,1cyclictest0-21swapper/009:21:210
1917688992119,1cyclictest0-21swapper/009:14:320
1917688992119,1cyclictest0-21swapper/008:15:380
1917688992119,1cyclictest0-21swapper/008:11:040
1917688992119,1cyclictest0-21swapper/008:05:440
1917688992119,1cyclictest0-21swapper/008:05:430
1917688992119,1cyclictest0-21swapper/007:51:300
1917688992112,7cyclictest1924544-21ntpq07:25:170
191768899210,20cyclictest0-21swapper/011:09:170
191768899210,20cyclictest0-21swapper/010:48:410
191768899210,20cyclictest0-21swapper/009:44:470
191768899210,20cyclictest0-21swapper/009:25:260
191768899210,20cyclictest0-21swapper/009:04:100
191768899210,20cyclictest0-21swapper/008:58:300
191768899210,20cyclictest0-21swapper/007:59:360
139099210,3rtkit-daemon1389-21rtkit-daemon11:30:052
139099210,14rtkit-daemon3056-21PK-Backend07:24:463
139099210,14rtkit-daemon3056-21PK-Backend07:16:013
139099210,14rtkit-daemon3056-21PK-Backend07:13:003
1917695992018,1cyclictest3056-21PK-Backend12:28:393
1917695992018,1cyclictest3056-21PK-Backend11:58:433
1917695992018,1cyclictest0-21swapper/309:46:363
1917695992018,1cyclictest0-21swapper/308:19:083
1917695992018,1cyclictest0-21swapper/308:03:003
1917695992017,2cyclictest3056-21PK-Backend10:11:373
1917695992013,4cyclictest1933431-21python307:50:213
191769599201,16cyclictest1981923-21cron10:10:003
1917695992010,7cyclictest436-20systemd-journal11:20:003
191769599200,1cyclictest3056-21PK-Backend10:34:143
191769599200,1cyclictest0-21swapper/309:27:023
191769599200,19cyclictest3056-21PK-Backend12:32:583
191769599200,19cyclictest3056-21PK-Backend11:26:393
191769599200,19cyclictest3056-21PK-Backend07:29:543
191769599200,19cyclictest0-21swapper/311:11:193
191769599200,19cyclictest0-21swapper/311:08:223
191769599200,19cyclictest0-21swapper/309:41:433
191769599200,17cyclictest2015141-21apt11:45:123
1917693992018,1cyclictest0-21swapper/212:39:422
1917693992018,1cyclictest0-21swapper/211:44:202
1917693992018,1cyclictest0-21swapper/211:37:032
1917693992018,1cyclictest0-21swapper/211:23:042
1917693992018,1cyclictest0-21swapper/211:06:542
1917693992018,1cyclictest0-21swapper/210:13:352
1917693992018,1cyclictest0-21swapper/209:59:292
1917693992018,1cyclictest0-21swapper/208:53:582
1917693992018,1cyclictest0-21swapper/208:40:062
1917693992018,1cyclictest0-21swapper/207:56:122
1917693992018,1cyclictest0-21swapper/207:51:062
1917693992018,1cyclictest0-21swapper/207:28:012
1917693992018,1cyclictest0-21swapper/207:10:092
1917693992017,2cyclictest3056-21PK-Backend12:14:412
1917693992017,2cyclictest1923555-21cron07:25:002
1917693992012,6cyclictest436-20systemd-journal09:00:002
1917693992012,6cyclictest1981920-21cron10:09:592
191769399200,19cyclictest0-21swapper/211:11:142
191769399200,19cyclictest0-21swapper/209:14:192
191769399200,19cyclictest0-21swapper/208:07:282
191769399200,19cyclictest0-21swapper/208:07:282
1917689992018,1cyclictest3056-21PK-Backend09:03:111
1917689992018,1cyclictest3056-21PK-Backend08:31:461
1917689992018,1cyclictest3056-21PK-Backend08:18:091
1917689992018,1cyclictest0-21swapper/112:11:351
1917689992018,1cyclictest0-21swapper/107:40:221
1917689992017,2cyclictest3056-21PK-Backend08:10:591
1917689992015,3cyclictest1975147-21hddtemp_smartct09:50:141
191768999200,1cyclictest3056-21PK-Backend09:15:201
191768999200,19cyclictest3056-21PK-Backend07:46:251
191768999200,19cyclictest0-21swapper/111:30:201
1917688992018,1cyclictest0-21swapper/011:50:120
1917688992018,1cyclictest0-21swapper/011:10:040
1917688992018,1cyclictest0-21swapper/011:02:130
1917688992018,1cyclictest0-21swapper/009:17:160
1917688992018,1cyclictest0-21swapper/008:42:270
1917688992018,1cyclictest0-21swapper/008:01:110
1917688992018,1cyclictest0-21swapper/007:10:490
1917688992015,3cyclictest2013573-21tr11:40:130
191768899200,1cyclictest0-21swapper/012:32:100
191768899200,1cyclictest0-21swapper/010:29:410
191768899200,1cyclictest0-21swapper/009:57:510
191768899200,19cyclictest0-21swapper/012:27:030
191768899200,19cyclictest0-21swapper/012:13:030
191768899200,19cyclictest0-21swapper/012:07:090
191768899200,19cyclictest0-21swapper/011:56:080
191768899200,19cyclictest0-21swapper/011:23:010
191768899200,19cyclictest0-21swapper/008:50:050
191768899200,19cyclictest0-21swapper/008:24:100
191768899200,19cyclictest0-21swapper/007:36:580
191768899200,19cyclictest0-21swapper/007:30:500
139099200,17rtkit-daemon1997-21gvfs-afc-volume12:17:112
139099200,14rtkit-daemon0-21swapper/309:31:123
139099200,14rtkit-daemon0-21swapper/208:35:122
1917695991917,1cyclictest3056-21PK-Backend12:19:123
1917695991917,1cyclictest3056-21PK-Backend12:09:463
1917695991917,1cyclictest3056-21PK-Backend10:24:413
1917695991917,1cyclictest0-21swapper/310:52:393
1917695991917,1cyclictest0-21swapper/310:46:593
1917695991917,1cyclictest0-21swapper/310:36:253
1917695991917,1cyclictest0-21swapper/309:02:153
1917695991917,1cyclictest0-21swapper/308:25:113
1917695991917,1cyclictest0-21swapper/308:20:313
1917695991917,1cyclictest0-21swapper/308:14:283
1917695991917,1cyclictest0-21swapper/307:59:153
1917695991917,1cyclictest0-21swapper/307:46:513
1917695991916,2cyclictest3056-21PK-Backend12:02:303
1917695991916,2cyclictest3056-21PK-Backend07:44:423
1917695991912,5cyclictest436-20systemd-journal11:44:193
191769599190,1cyclictest3056-21PK-Backend12:23:313
191769599190,1cyclictest0-21swapper/308:57:563
191769599190,1cyclictest0-21swapper/308:07:333
191769599190,1cyclictest0-21swapper/308:07:333
1917693991917,1cyclictest0-21swapper/212:31:372
1917693991917,1cyclictest0-21swapper/210:01:382
1917693991917,1cyclictest0-21swapper/209:20:352
1917693991917,1cyclictest0-21swapper/209:06:092
1917693991917,1cyclictest0-21swapper/209:06:092
1917693991917,1cyclictest0-21swapper/209:01:502
1917693991911,6cyclictest2021787-21cron12:04:592
191769399190,1cyclictest0-21swapper/209:26:032
191769399190,1cyclictest0-21swapper/208:02:072
191769399190,1cyclictest0-21swapper/207:48:082
191769399190,18cyclictest0-21swapper/209:19:482
1917689991917,1cyclictest3056-21PK-Backend10:48:411
1917689991917,1cyclictest3056-21PK-Backend09:56:371
1917689991917,1cyclictest3056-21PK-Backend07:57:061
1917689991917,1cyclictest0-21swapper/112:15:561
1917689991917,1cyclictest0-21swapper/108:36:141
1917689991916,2cyclictest3056-21PK-Backend08:26:461
1917689991914,3cyclictest1927044-21sh07:35:001
1917689991912,5cyclictest436-20systemd-journal12:25:301
191768999190,1cyclictest3056-21PK-Backend09:10:201
191768999190,1cyclictest0-21swapper/110:37:131
191768999190,18cyclictest3056-21PK-Backend07:10:351
191768999190,18cyclictest0-21swapper/112:00:471
191768999190,18cyclictest0-21swapper/111:29:321
1917688991917,1cyclictest0-21swapper/012:38:040
1917688991917,1cyclictest0-21swapper/010:53:000
1917688991917,1cyclictest0-21swapper/007:21:560
139099190,13rtkit-daemon3056-21PK-Backend07:38:193
139099190,13rtkit-daemon0-21swapper/309:08:383
139099190,13rtkit-daemon0-21swapper/309:08:383
191769599183,13cyclictest1987989-21wc10:25:183
1917695991816,1cyclictest0-21swapper/309:36:483
1917695991815,2cyclictest3056-21PK-Backend11:31:473
1917695991814,3cyclictest978-21snmpd10:55:293
191769599181,12cyclictest2000396-21runrttasks11:00:223
1917695991810,6cyclictest1947004-21apt08:30:133
1917693991816,1cyclictest0-21swapper/210:37:272
1917693991816,1cyclictest0-21swapper/208:49:042
1917693991816,1cyclictest0-21swapper/207:33:202
191769399180,17cyclictest0-21swapper/212:08:472
1917689991816,1cyclictest3056-21PK-Backend08:54:381
1917689991816,1cyclictest0-21swapper/112:36:431
1917689991816,1cyclictest0-21swapper/110:43:271
1917689991816,1cyclictest0-21swapper/107:15:161
1917689991815,2cyclictest3056-21PK-Backend07:54:231
1917689991812,5cyclictest1990121-21cat10:30:221
1917689991811,5cyclictest1978473-21apt10:00:111
1917688991816,1cyclictest0-21swapper/012:18:580
1917688991816,1cyclictest0-21swapper/012:04:120
1917688991816,1cyclictest0-21swapper/010:09:000
1917688991816,1cyclictest0-21swapper/009:07:090
1917688991816,1cyclictest0-21swapper/009:07:080
1917688991816,1cyclictest0-21swapper/007:41:310
1917688991813,4cyclictest1967777-21/usr/sbin/munin09:30:150
1917688991811,5cyclictest1947853-21cut08:30:220
1917688991810,2cyclictest13-21ksoftirqd/007:48:150
191768899180,1cyclictest0-21swapper/011:25:590
1917695991715,1cyclictest3056-21PK-Backend12:10:333
1917695991715,1cyclictest3056-21PK-Backend11:38:163
1917693991712,3cyclictest1942250-21if_enp2s008:15:162
1917689991715,1cyclictest3056-21PK-Backend11:51:011
1917689991715,1cyclictest3056-21PK-Backend11:01:061
1917689991715,1cyclictest3056-21PK-Backend09:07:501
1917689991715,1cyclictest3056-21PK-Backend09:07:501
1917689991714,2cyclictest3056-21PK-Backend09:46:221
191768999170,16cyclictest3056-21PK-Backend08:02:341
191768999170,16cyclictest0-21swapper/112:33:461
1917688991715,1cyclictest0-21swapper/010:40:170
1917688991715,1cyclictest0-21swapper/009:51:020
1917688991715,1cyclictest0-21swapper/008:38:210
1917688991712,3cyclictest1973143-21cpuspeed_turbos09:45:140
1917688991711,4cyclictest1946284-21grep08:25:220
1917693991611,4cyclictest1971817-21wc09:40:172
1917693991610,5cyclictest2005225-21cut11:15:192
191768999166,9cyclictest1952935-21grep08:45:181
1917689991614,1cyclictest3056-21PK-Backend10:59:441
1917689991614,1cyclictest3056-21PK-Backend09:36:091
1917689991613,2cyclictest3056-21PK-Backend08:06:051
1917689991613,2cyclictest3056-21PK-Backend08:06:041
1917689991610,4cyclictest2007950-21basename11:25:001
191768899169,5cyclictest1952249-21cpu08:45:110
191768999159,4cyclictest1966737-21cut09:25:181
191769399149,4cyclictest1927503-21cut07:35:122
191768999146,2cyclictest141rcu_preempt10:50:141
1917689991412,1cyclictest3056-21PK-Backend09:44:271
191768999140,13cyclictest3056-21PK-Backend09:34:471
1917689991311,1cyclictest3056-21PK-Backend08:59:521
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional