You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-19 - 16:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackcslot7s.osadl.org (updated Thu Mar 19, 2026 12:44:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
5331612980,3sleep03056-21PK-Backend09:20:120
139099820,71rtkit-daemon0-21swapper/007:08:040
48454527145,18sleep30-21swapper/307:05:113
48569226343,14sleep20-21swapper/207:05:462
48589826244,13sleep10-21swapper/107:08:261
5715742460,4sleep13056-21PK-Backend11:10:011
5715742460,4sleep13056-21PK-Backend11:10:011
5958002390,3sleep00-21swapper/012:20:010
5529922290,3sleep00-21swapper/010:15:180
5104432280,3sleep10-21swapper/108:15:171
48616799260,24cyclictest522203-21apt-config08:50:013
486167992511,12cyclictest515524-21df_inode08:30:133
486161992510,13cyclictest548707-21unin-run10:05:001
139099250,4rtkit-daemon1389-21rtkit-daemon09:10:310
139099250,4rtkit-daemon1389-21rtkit-daemon07:31:031
486157992416,6cyclictest552172-21unin-run10:14:590
486157992416,6cyclictest552172-21unin-run10:14:590
486161992321,1cyclictest0-21swapper/107:14:061
486161992317,4cyclictest525082-21grep08:55:191
486161992314,7cyclictest436-20systemd-journal09:05:001
139099230,3rtkit-daemon1389-21rtkit-daemon09:05:330
139099230,3rtkit-daemon1389-21rtkit-daemon07:55:210
139099230,14rtkit-daemon0-21swapper/011:15:220
48616799221,19cyclictest525274-21/usr/sbin/munin08:55:213
48616799220,20cyclictest3056-21PK-Backend11:02:503
48616799220,20cyclictest3056-21PK-Backend10:04:033
48616399220,3cyclictest547062-21grep09:59:592
486161992220,1cyclictest0-21swapper/110:49:301
486161992220,1cyclictest0-21swapper/109:29:471
48616199220,20cyclictest497032-21apt-get07:40:031
48615799222,6cyclictest495517-21apt07:35:110
486157992220,1cyclictest0-21swapper/012:34:440
486157992220,1cyclictest0-21swapper/011:30:210
486157992220,1cyclictest0-21swapper/011:29:200
486157992220,1cyclictest0-21swapper/010:50:340
486157992220,1cyclictest0-21swapper/007:11:130
48615799221,6cyclictest545473-21apt09:55:100
48615799221,6cyclictest490316-21apt07:20:100
486157992212,8cyclictest436-20systemd-journal10:33:350
486157992210,8cyclictest575213-21apt11:20:110
48615799220,21cyclictest0-21swapper/007:27:010
48615799220,20cyclictest536550-21apt09:30:100
139099220,14rtkit-daemon0-21swapper/112:00:211
5117982210,3sleep2331rcuc/208:20:122
48616799213,15cyclictest555613-21perf10:25:003
48616799210,2cyclictest42-21ksoftirqd/311:26:283
48616799210,19cyclictest3056-21PK-Backend12:24:223
48616799210,19cyclictest3056-21PK-Backend11:41:303
48616799210,19cyclictest3056-21PK-Backend11:22:513
48616799210,19cyclictest3056-21PK-Backend10:06:533
48616799210,19cyclictest3056-21PK-Backend09:13:273
48616799210,19cyclictest3056-21PK-Backend07:22:553
486163992119,1cyclictest0-21swapper/208:27:272
486163992112,7cyclictest596752-21ntp_states12:20:172
48616399210,20cyclictest0-21swapper/210:17:042
48616399210,20cyclictest0-21swapper/210:05:422
48616399210,20cyclictest0-21swapper/207:18:322
486161992119,1cyclictest3056-21PK-Backend08:42:141
486161992119,1cyclictest0-21swapper/111:23:361
486161992119,1cyclictest0-21swapper/110:12:531
486161992119,1cyclictest0-21swapper/110:12:531
486161992119,1cyclictest0-21swapper/109:55:151
486161992119,1cyclictest0-21swapper/109:52:251
486161992119,1cyclictest0-21swapper/109:10:531
486161992119,1cyclictest0-21swapper/109:08:171
486161992119,1cyclictest0-21swapper/108:13:211
486161992119,1cyclictest0-21swapper/108:04:571
486161992119,1cyclictest0-21swapper/107:29:011
486161992118,2cyclictest0-21swapper/108:45:321
486161992114,6cyclictest883-21dbus-daemon11:45:011
486161992113,6cyclictest497032-21apt-get07:40:001
48616199210,20cyclictest3056-21PK-Backend10:22:121
48616199210,20cyclictest3056-21PK-Backend08:52:081
48616199210,20cyclictest3056-21PK-Backend08:36:541
48616199210,20cyclictest0-21swapper/111:31:071
48616199210,20cyclictest0-21swapper/110:52:071
48616199210,20cyclictest0-21swapper/110:27:521
48615799212,7cyclictest504471-21/usr/sbin/munin08:00:150
486157992119,1cyclictest0-21swapper/012:01:180
486157992119,1cyclictest0-21swapper/011:55:020
486157992119,1cyclictest0-21swapper/010:28:440
486157992119,1cyclictest0-21swapper/009:27:330
486157992119,1cyclictest0-21swapper/008:09:050
486157992119,1cyclictest0-21swapper/008:09:050
486157992119,1cyclictest0-21swapper/007:44:180
486157992118,2cyclictest13-21ksoftirqd/008:16:220
486157992115,5cyclictest564537-21cron10:50:010
486157992113,6cyclictest548765-21cut10:05:000
486157992113,6cyclictest1-21systemd11:45:010
48615799210,7cyclictest5402312dpkg09:40:020
48615799210,20cyclictest13-21ksoftirqd/009:39:020
48615799210,20cyclictest0-21swapper/010:36:410
48615799210,20cyclictest0-21swapper/010:21:000
48615799210,20cyclictest0-21swapper/009:17:060
48615799210,19cyclictest3056-21PK-Backend08:44:140
48615799210,10cyclictest545144-21runrttasks09:54:240
139099210,13rtkit-daemon0-21swapper/011:51:160
486167992017,2cyclictest3056-21PK-Backend11:38:383
486167992017,2cyclictest3056-21PK-Backend10:42:143
486167992017,2cyclictest3056-21PK-Backend10:36:203
486167992017,2cyclictest3056-21PK-Backend07:59:103
486167992017,2cyclictest0-21swapper/311:10:073
486167992017,2cyclictest0-21swapper/309:29:073
48616799200,1cyclictest3056-21PK-Backend09:31:453
48616799200,1cyclictest3056-21PK-Backend08:17:023
48616799200,1cyclictest0-21swapper/309:16:033
48616799200,19cyclictest3056-21PK-Backend12:27:463
48616799200,19cyclictest3056-21PK-Backend11:15:343
48616799200,19cyclictest3056-21PK-Backend09:38:483
48616799200,19cyclictest3056-21PK-Backend07:34:373
48616799200,19cyclictest3056-21PK-Backend07:13:213
48616799200,19cyclictest0-21swapper/311:55:213
48616799200,19cyclictest0-21swapper/311:09:053
48616799200,19cyclictest0-21swapper/311:09:053
48616799200,19cyclictest0-21swapper/309:24:413
48616799200,18cyclictest3056-21PK-Backend11:50:093
486163992018,1cyclictest0-21swapper/212:36:352
486163992018,1cyclictest0-21swapper/212:26:082
486163992018,1cyclictest0-21swapper/210:48:402
486163992018,1cyclictest0-21swapper/210:44:352
486163992018,1cyclictest0-21swapper/209:53:322
486163992018,1cyclictest0-21swapper/209:44:122
486163992018,1cyclictest0-21swapper/208:37:532
48616399200,5cyclictest584328-21awk11:45:152
48616399200,1cyclictest0-21swapper/212:32:102
48616399200,1cyclictest0-21swapper/212:11:002
48616399200,1cyclictest0-21swapper/211:23:012
48616399200,1cyclictest0-21swapper/211:00:102
48616399200,1cyclictest0-21swapper/209:14:452
48616399200,19cyclictest0-21swapper/211:56:272
48616399200,19cyclictest0-21swapper/211:36:252
48616399200,19cyclictest0-21swapper/211:32:342
48616399200,19cyclictest0-21swapper/211:28:422
48616399200,19cyclictest0-21swapper/211:08:142
48616399200,19cyclictest0-21swapper/211:08:142
48616399200,19cyclictest0-21swapper/208:57:072
48616399200,19cyclictest0-21swapper/208:02:192
48616399200,19cyclictest0-21swapper/207:44:072
48616399200,18cyclictest3056-21PK-Backend07:45:362
486161992018,1cyclictest0-21swapper/110:32:461
486161992018,1cyclictest0-21swapper/110:19:221
486161992018,1cyclictest0-21swapper/110:05:211
486161992018,1cyclictest0-21swapper/107:21:171
48616199200,1cyclictest0-21swapper/108:06:391
48616199200,1cyclictest0-21swapper/108:06:391
48616199200,19cyclictest3056-21PK-Backend11:11:401
48616199200,19cyclictest3056-21PK-Backend09:16:561
48616199200,19cyclictest0-21swapper/112:31:371
48616199200,19cyclictest0-21swapper/112:29:001
48616199200,19cyclictest0-21swapper/112:21:221
48616199200,19cyclictest0-21swapper/112:15:201
48616199200,19cyclictest0-21swapper/111:28:161
48616199200,19cyclictest0-21swapper/109:49:341
48615799205,14cyclictest542371-21df09:45:130
48615799203,4cyclictest2156-21gnome-shell08:25:090
486157992018,1cyclictest0-21swapper/010:40:460
486157992018,1cyclictest0-21swapper/008:56:510
486157992012,6cyclictest570226-21seq11:05:110
486157992012,6cyclictest570226-21seq11:05:110
48615799200,1cyclictest3056-21PK-Backend08:35:350
48615799200,1cyclictest0-21swapper/008:11:360
48615799200,19cyclictest13-21ksoftirqd/010:59:130
48615799200,19cyclictest0-21swapper/012:37:210
48615799200,19cyclictest0-21swapper/012:26:040
48615799200,19cyclictest0-21swapper/011:46:580
48615799200,19cyclictest0-21swapper/010:08:360
48615799200,19cyclictest0-21swapper/009:01:380
139099200,16rtkit-daemon486151-21cyclictest11:00:321
486167991917,1cyclictest3056-21PK-Backend12:01:373
486167991917,1cyclictest3056-21PK-Backend09:40:373
486167991917,1cyclictest3056-21PK-Backend08:12:293
486167991916,2cyclictest3056-21PK-Backend09:53:073
486167991916,2cyclictest3056-21PK-Backend07:27:473
48616799190,1cyclictest3056-21PK-Backend12:38:013
48616799190,1cyclictest3056-21PK-Backend12:08:413
48616799190,1cyclictest3056-21PK-Backend09:05:493
48616799190,1cyclictest3056-21PK-Backend07:47:353
48616799190,18cyclictest0-21swapper/308:40:073
48616799190,16cyclictest496638-21chrt07:35:463
486163991917,1cyclictest0-21swapper/212:15:402
486163991917,1cyclictest0-21swapper/211:54:382
486163991917,1cyclictest0-21swapper/211:41:192
486163991917,1cyclictest0-21swapper/210:55:442
486163991917,1cyclictest0-21swapper/210:12:242
486163991917,1cyclictest0-21swapper/210:12:242
486163991917,1cyclictest0-21swapper/208:17:402
486163991917,1cyclictest0-21swapper/207:27:512
486163991914,4cyclictest542182-21cpuspeed_turbos09:45:132
486163991914,4cyclictest34-21ksoftirqd/209:40:012
486163991914,3cyclictest555609-21sh10:24:592
486163991912,5cyclictest533276-21wc09:20:132
486163991912,5cyclictest521339-21cat08:45:212
486163991911,6cyclictest573477-21apt11:15:112
48616399190,1cyclictest0-21swapper/212:04:322
48616399190,1cyclictest0-21swapper/210:26:372
48616399190,1cyclictest0-21swapper/209:27:022
48616399190,1cyclictest0-21swapper/209:06:062
48616399190,1cyclictest0-21swapper/208:42:142
48616399190,1cyclictest0-21swapper/208:11:382
48616399190,1cyclictest0-21swapper/207:21:572
48616399190,18cyclictest0-21swapper/209:33:162
486161991917,1cyclictest3056-21PK-Backend09:22:571
486161991917,1cyclictest0-21swapper/112:13:311
486161991917,1cyclictest0-21swapper/111:50:191
486161991917,1cyclictest0-21swapper/111:45:051
486161991917,1cyclictest0-21swapper/110:38:411
486161991917,1cyclictest0-21swapper/109:35:131
486161991917,1cyclictest0-21swapper/107:55:371
486161991917,1cyclictest0-21swapper/107:51:111
486161991913,4cyclictest26-21ksoftirqd/109:45:001
486161991912,5cyclictest515297-21expr08:30:121
486161991910,8cyclictest26-21ksoftirqd/108:25:001
48616199190,18cyclictest0-21swapper/111:36:481
48615799192,12cyclictest592549-21apt12:10:110
486157991917,1cyclictest3056-21PK-Backend08:45:290
486157991917,1cyclictest0-21swapper/012:22:400
486157991917,1cyclictest0-21swapper/011:00:130
486157991917,1cyclictest0-21swapper/008:50:010
486157991913,4cyclictest1095-21runrttasks07:15:010
486157991912,5cyclictest512128-21awk08:20:150
48615799191,15cyclictest581894-21turbostat11:40:010
48615799190,1cyclictest0-21swapper/012:07:330
48615799190,1cyclictest0-21swapper/007:31:340
139099190,13rtkit-daemon0-21swapper/111:16:331
486167991816,1cyclictest3056-21PK-Backend12:15:573
486167991816,1cyclictest3056-21PK-Backend08:00:523
486167991816,1cyclictest3056-21PK-Backend07:44:513
486167991816,1cyclictest0-21swapper/309:00:363
486167991815,2cyclictest3056-21PK-Backend10:31:273
486167991815,2cyclictest3056-21PK-Backend10:27:353
48616799181,12cyclictest522679-21apt08:50:113
486163991816,1cyclictest0-21swapper/212:05:322
486163991816,1cyclictest0-21swapper/210:53:542
486163991816,1cyclictest0-21swapper/209:18:232
486163991816,1cyclictest0-21swapper/208:07:252
486163991816,1cyclictest0-21swapper/208:07:252
486163991811,5cyclictest497026-21cron07:39:592
486163991810,6cyclictest515550-21fw_packets08:30:142
486161991816,1cyclictest0-21swapper/111:57:231
486161991816,1cyclictest0-21swapper/110:56:321
486161991816,1cyclictest0-21swapper/110:40:441
486161991812,4cyclictest592309-21systemd-run12:10:001
486161991812,4cyclictest26-21ksoftirqd/112:40:011
486161991810,6cyclictest537624-21who09:30:211
486161991810,6cyclictest513740-21expr08:25:121
48615799189,5cyclictest501032-21apt07:50:100
48615799183,13cyclictest516324-21chrt08:31:210
48615799181,7cyclictest13-21ksoftirqd/011:10:430
486157991812,5cyclictest13-21ksoftirqd/007:45:210
5936212170,4sleep33056-21PK-Backend12:10:213
486167991715,1cyclictest3056-21PK-Backend10:56:493
486167991715,1cyclictest3056-21PK-Backend09:49:293
486167991715,1cyclictest3056-21PK-Backend07:54:453
486163991715,1cyclictest3056-21PK-Backend10:35:362
486163991715,1cyclictest0-21swapper/210:02:502
486163991715,1cyclictest0-21swapper/207:31:232
486163991712,4cyclictest572084-21expr11:10:112
486163991710,5cyclictest522641-21dpkg08:50:022
486161991710,5cyclictest488407-21expr07:15:021
48616799163,8cyclictest516894-21apt08:35:123
486167991614,1cyclictest3056-21PK-Backend10:54:123
486167991614,1cyclictest3056-21PK-Backend10:12:343
486167991614,1cyclictest3056-21PK-Backend10:12:333
486167991614,1cyclictest3056-21PK-Backend08:28:373
48616799160,14cyclictest553402-21timerandwakeup10:15:223
486163991614,1cyclictest0-21swapper/210:33:332
486163991614,1cyclictest0-21swapper/207:11:022
486161991614,1cyclictest0-21swapper/107:49:421
486167991513,1cyclictest3056-21PK-Backend12:33:483
486167991513,1cyclictest3056-21PK-Backend11:33:593
486163991513,1cyclictest0-21swapper/207:50:022
48616799149,4cyclictest3056-21PK-Backend10:47:533
48616799149,4cyclictest3056-21PK-Backend08:20:093
48616799140,12cyclictest507889-21grep08:10:013
48616799140,12cyclictest507889-21grep08:10:013
48616399148,4cyclictest2156-21gnome-shell07:56:092
48616399147,5cyclictest526110-21seq09:00:032
486167991311,1cyclictest3056-21PK-Backend11:46:443
486167991311,1cyclictest0-21swapper/309:55:573
48616799130,11cyclictest489525-21xargs07:15:213
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional