You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-24 - 06:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackcslot7s.osadl.org (updated Fri Jul 24, 2026 00:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
85165322670,9sleep10-21swapper/119:07:261
85078022500,9sleep30-21swapper/319:05:153
85088222300,15sleep234-21ksoftirqd/219:05:192
139099780,66rtkit-daemon0-21swapper/019:08:210
139099580,4rtkit-daemon1389-21rtkit-daemon20:46:152
9321082560,3sleep00-21swapper/022:55:140
9256552470,4sleep20-21swapper/222:35:192
139099460,4rtkit-daemon1389-21rtkit-daemon20:45:141
8664282410,3sleep10-21swapper/119:50:011
8807202370,4sleep13056-21PK-Backend20:30:111
9019622360,2sleep30-21swapper/321:30:123
139099320,2rtkit-daemon0-21swapper/119:40:491
139099310,2rtkit-daemon26-21ksoftirqd/119:19:121
139099280,4rtkit-daemon1389-21rtkit-daemon23:00:300
9324572270,6sleep1261ksoftirqd/122:55:191
8795972270,7sleep0131ksoftirqd/020:25:170
85197799270,24cyclictest1389-21rtkit-daemon20:45:140
139099270,4rtkit-daemon1389-21rtkit-daemon23:43:570
139099270,4rtkit-daemon1389-21rtkit-daemon00:04:450
851988992618,6cyclictest882165-21awk20:35:003
139099260,4rtkit-daemon1389-21rtkit-daemon23:55:011
139099260,4rtkit-daemon1389-21rtkit-daemon23:48:460
139099260,4rtkit-daemon1389-21rtkit-daemon23:31:071
139099260,4rtkit-daemon1389-21rtkit-daemon22:28:450
9525292250,4sleep33056-21PK-Backend23:54:593
139099250,4rtkit-daemon1389-21rtkit-daemon23:33:460
8700732230,2sleep30-21swapper/320:00:013
8700732230,2sleep30-21swapper/320:00:013
851988992318,3cyclictest866287-21dump-pmu-power19:50:003
851988992318,3cyclictest42-21ksoftirqd/322:21:413
851984992320,2cyclictest902148-21smartctl21:30:152
851984992320,2cyclictest0-21swapper/222:42:002
85198499230,22cyclictest889346-21latency_hist20:55:002
85197799230,21cyclictest945-21thermald19:53:290
139099230,4rtkit-daemon1389-21rtkit-daemon23:18:520
139099230,4rtkit-daemon1389-21rtkit-daemon23:06:210
139099230,4rtkit-daemon1389-21rtkit-daemon22:16:210
139099230,4rtkit-daemon1389-21rtkit-daemon20:01:200
139099230,4rtkit-daemon1389-21rtkit-daemon20:01:200
139099230,4rtkit-daemon1389-21rtkit-daemon19:57:190
139099230,4rtkit-daemon1389-21rtkit-daemon19:57:190
8523672220,2sleep20-21swapper/219:10:122
851988992220,1cyclictest3056-21PK-Backend20:43:073
851988992220,1cyclictest0-21swapper/322:59:143
851988992214,6cyclictest860204-21memory19:30:163
85198899220,20cyclictest3056-21PK-Backend23:32:193
851984992220,1cyclictest0-21swapper/223:41:352
851984992220,1cyclictest0-21swapper/221:36:232
851984992220,1cyclictest0-21swapper/221:24:062
851984992220,1cyclictest0-21swapper/220:02:552
851984992220,1cyclictest0-21swapper/220:02:552
851982992217,3cyclictest920807-21sh22:25:001
85198299220,20cyclictest901223-21chrt21:26:571
85198299220,20cyclictest3056-21PK-Backend20:19:451
851977992214,6cyclictest883-21dbus-daemon19:45:000
139099220,3rtkit-daemon1389-21rtkit-daemon22:30:550
139099220,15rtkit-daemon3056-21PK-Backend21:49:283
851988992119,1cyclictest3056-21PK-Backend21:21:473
851988992119,1cyclictest3056-21PK-Backend19:16:213
851988992119,1cyclictest0-21swapper/323:10:163
851988992119,1cyclictest0-21swapper/322:42:043
851988992119,1cyclictest0-21swapper/321:44:193
851988992119,1cyclictest0-21swapper/321:02:543
851988992119,1cyclictest0-21swapper/320:15:503
851988992119,1cyclictest0-21swapper/320:14:483
851988992119,1cyclictest0-21swapper/319:54:203
851988992119,1cyclictest0-21swapper/319:26:563
851988992119,1cyclictest0-21swapper/300:23:373
851988992118,2cyclictest3056-21PK-Backend23:55:383
851988992118,2cyclictest3056-21PK-Backend23:43:353
85198899210,20cyclictest3056-21PK-Backend00:11:063
85198899210,20cyclictest0-21swapper/321:10:453
85198899210,20cyclictest0-21swapper/319:21:073
85198899210,19cyclictest3056-21PK-Backend23:47:003
85198899210,19cyclictest3056-21PK-Backend19:12:223
85198499213,17cyclictest1095-21runrttasks21:09:322
851984992119,1cyclictest0-21swapper/223:55:412
851984992119,1cyclictest0-21swapper/223:46:012
851984992119,1cyclictest0-21swapper/223:24:522
851984992119,1cyclictest0-21swapper/223:12:492
851984992119,1cyclictest0-21swapper/222:27:132
851984992119,1cyclictest0-21swapper/221:52:392
851984992119,1cyclictest0-21swapper/221:45:432
851984992119,1cyclictest0-21swapper/221:25:422
851984992119,1cyclictest0-21swapper/221:17:242
851984992119,1cyclictest0-21swapper/219:41:052
851984992119,1cyclictest0-21swapper/200:35:502
851984992119,1cyclictest0-21swapper/200:25:072
85198499210,20cyclictest0-21swapper/223:53:522
85198499210,20cyclictest0-21swapper/222:58:222
85198499210,20cyclictest0-21swapper/221:05:002
85198499210,20cyclictest0-21swapper/219:52:472
85198499210,20cyclictest0-21swapper/219:49:092
85198499210,20cyclictest0-21swapper/200:12:242
85198499210,20cyclictest0-21swapper/200:06:572
85198499210,19cyclictest0-21swapper/219:15:572
851982992119,1cyclictest3056-21PK-Backend22:53:231
851982992119,1cyclictest3056-21PK-Backend22:53:231
851982992118,2cyclictest3056-21PK-Backend00:27:391
851982992112,7cyclictest950536-21apt-get23:50:001
85198299210,20cyclictest0-21swapper/122:00:231
85198299210,20cyclictest0-21swapper/121:45:561
85198299210,19cyclictest3056-21PK-Backend21:02:301
851977992113,6cyclictest968142-21cron00:40:000
851977992110,7cyclictest889353-21idleruntime-cro20:55:000
85197799210,20cyclictest0-21swapper/021:42:100
85197799210,20cyclictest0-21swapper/020:19:230
85197799210,19cyclictest3056-21PK-Backend20:55:330
85197799210,19cyclictest3056-21PK-Backend20:55:330
139099210,3rtkit-daemon1389-21rtkit-daemon19:27:570
139099210,15rtkit-daemon3056-21PK-Backend21:52:223
139099210,14rtkit-daemon0-21swapper/200:15:102
139099210,13rtkit-daemon42-21ksoftirqd/320:58:563
139099210,13rtkit-daemon42-21ksoftirqd/320:58:563
139099210,13rtkit-daemon0-21swapper/221:57:502
851988992018,1cyclictest3056-21PK-Backend19:40:143
851988992018,1cyclictest3056-21PK-Backend19:38:253
851988992018,1cyclictest3056-21PK-Backend00:39:323
851988992018,1cyclictest0-21swapper/322:51:033
851988992018,1cyclictest0-21swapper/322:51:033
851988992018,1cyclictest0-21swapper/322:07:503
851988992018,1cyclictest0-21swapper/321:18:493
851988992018,1cyclictest0-21swapper/321:05:043
851988992018,1cyclictest0-21swapper/320:27:253
85198899201,17cyclictest918182-21memory22:15:183
85198899200,19cyclictest3056-21PK-Backend22:26:433
85198899200,19cyclictest3056-21PK-Backend20:49:303
85198899200,19cyclictest0-21swapper/323:03:263
85198899200,19cyclictest0-21swapper/321:27:413
85198899200,19cyclictest0-21swapper/320:36:453
85198899200,19cyclictest0-21swapper/319:57:593
85198899200,19cyclictest0-21swapper/319:57:583
85198899200,19cyclictest0-21swapper/300:28:033
851984992018,1cyclictest0-21swapper/223:35:202
851984992018,1cyclictest0-21swapper/222:34:362
851984992018,1cyclictest0-21swapper/222:11:182
851984992018,1cyclictest0-21swapper/220:05:452
851984992018,1cyclictest0-21swapper/200:04:202
851984992012,6cyclictest885873-21cron20:45:002
851984992012,6cyclictest882167-21perf20:35:002
85198499200,1cyclictest0-21swapper/220:28:312
85198499200,19cyclictest0-21swapper/223:01:472
85198499200,19cyclictest0-21swapper/221:43:192
85198499200,19cyclictest0-21swapper/221:13:392
85198499200,19cyclictest0-21swapper/219:38:152
85198499200,19cyclictest0-21swapper/219:24:562
85198499200,19cyclictest0-21swapper/200:24:072
851982992018,1cyclictest0-21swapper/121:58:471
851982992012,6cyclictest918675-21awk22:15:241
851982992012,6cyclictest883-21dbus-daemon23:45:001
851982992011,7cyclictest951068-21awk23:50:121
85198299200,1cyclictest0-21swapper/100:02:311
85198299200,19cyclictest0-21swapper/121:21:021
85198299200,18cyclictest3056-21PK-Backend23:23:581
85198299200,18cyclictest3056-21PK-Backend23:00:191
851977992018,1cyclictest0-21swapper/022:46:180
851977992017,2cyclictest3056-21PK-Backend22:05:090
851977992016,3cyclictest961206-21cron00:20:000
851977992015,3cyclictest854579-21grep19:15:130
851977992014,5cyclictest966444-21systemd-run00:35:010
851977992013,5cyclictest881260-21sed20:30:160
851977992011,7cyclictest954258-21cron00:00:000
85197799200,1cyclictest0-21swapper/000:06:420
85197799200,19cyclictest0-21swapper/023:51:140
85197799200,19cyclictest0-21swapper/023:29:310
85197799200,19cyclictest0-21swapper/021:08:040
85197799200,19cyclictest0-21swapper/019:49:010
85197799200,19cyclictest0-21swapper/019:12:180
139099200,13rtkit-daemon0-21swapper/220:55:432
139099200,13rtkit-daemon0-21swapper/220:55:422
851988991917,1cyclictest3056-21PK-Backend23:37:333
851988991917,1cyclictest3056-21PK-Backend21:36:003
851988991917,1cyclictest3056-21PK-Backend00:09:173
851988991917,1cyclictest0-21swapper/323:06:033
851988991917,1cyclictest0-21swapper/322:01:423
851988991917,1cyclictest0-21swapper/320:22:053
851988991917,1cyclictest0-21swapper/300:31:413
851988991916,2cyclictest3056-21PK-Backend00:03:153
851988991914,3cyclictest872769-21ntp_states20:05:193
85198899190,1cyclictest0-21swapper/322:13:583
85198899190,1cyclictest0-21swapper/300:19:583
851984991917,1cyclictest0-21swapper/222:01:582
851984991917,1cyclictest0-21swapper/220:15:182
851984991917,1cyclictest0-21swapper/220:11:262
851984991915,3cyclictest978-21snmpd22:21:432
851984991914,4cyclictest978-21snmpd19:34:412
851984991912,5cyclictest868919-21ls19:55:182
851984991912,5cyclictest868919-21ls19:55:182
85198499190,1cyclictest0-21swapper/223:30:052
85198499190,18cyclictest0-21swapper/223:16:142
85198499190,18cyclictest0-21swapper/222:08:072
851982991917,1cyclictest3056-21PK-Backend22:45:391
851982991917,1cyclictest3056-21PK-Backend21:16:091
851982991917,1cyclictest3056-21PK-Backend20:01:261
851982991917,1cyclictest3056-21PK-Backend20:01:261
851982991917,1cyclictest0-21swapper/123:37:371
851982991917,1cyclictest0-21swapper/121:44:211
851982991917,1cyclictest0-21swapper/100:37:381
851982991917,1cyclictest0-21swapper/100:16:371
851982991916,2cyclictest3056-21PK-Backend22:40:181
851982991914,3cyclictest903490-21grep21:35:121
851982991914,3cyclictest2156-21gnome-shell23:10:091
851982991913,5cyclictest922555-21apt-get22:30:001
851982991912,5cyclictest923264-21expr22:30:121
851982991910,7cyclictest958379-21df00:10:151
85198299190,1cyclictest0-21swapper/120:44:461
85198299190,1cyclictest0-21swapper/119:38:421
85198299190,1cyclictest0-21swapper/119:14:211
85198299190,18cyclictest3056-21PK-Backend23:08:031
85198299190,18cyclictest3056-21PK-Backend19:25:301
85198299190,17cyclictest3056-21PK-Backend20:21:201
85197799192,12cyclictest910412-21apt21:55:120
851977991917,1cyclictest0-21swapper/023:37:220
851977991917,1cyclictest0-21swapper/023:20:180
851977991917,1cyclictest0-21swapper/021:19:390
851977991917,1cyclictest0-21swapper/021:04:320
851977991917,1cyclictest0-21swapper/020:23:220
851977991917,1cyclictest0-21swapper/020:13:420
851977991917,1cyclictest0-21swapper/000:10:210
851977991914,3cyclictest917064-21latency_hist22:15:010
851977991913,4cyclictest963406-21cpuspeed_turbos00:25:120
85197799190,1cyclictest0-21swapper/022:02:450
85197799190,18cyclictest0-21swapper/021:47:310
85197799190,18cyclictest0-21swapper/020:35:390
85197799190,18cyclictest0-21swapper/019:35:430
139099190,16rtkit-daemon1317-21systemd22:40:180
139099190,16rtkit-daemon1317-21systemd20:41:530
851988991816,1cyclictest3056-21PK-Backend23:27:193
851988991816,1cyclictest0-21swapper/323:24:423
85198899180,16cyclictest928329-21cpuspeed22:45:123
85198499189,7cyclictest883146-21cat20:35:152
851984991816,1cyclictest0-21swapper/220:23:572
851984991816,1cyclictest0-21swapper/200:34:012
85198499180,7cyclictest436-20systemd-journal22:50:002
851982991816,1cyclictest3056-21PK-Backend23:16:001
851982991816,1cyclictest0-21swapper/121:51:171
851982991814,3cyclictest924808-21apt22:35:101
85198299180,16cyclictest3056-21PK-Backend20:10:051
85197799187,8cyclictest883-21dbus-daemon21:55:000
851977991816,1cyclictest3056-21PK-Backend00:21:020
851977991816,1cyclictest0-21swapper/021:30:550
851977991816,1cyclictest0-21swapper/021:12:230
851977991813,3cyclictest899996-21acpi21:25:110
85197799180,1cyclictest0-21swapper/019:31:170
139099180,15rtkit-daemon1317-21systemd22:54:590
139099180,15rtkit-daemon1317-21systemd22:54:590
8601842170,2sleep13056-21PK-Backend19:30:161
851988991711,5cyclictest925339-21cat22:35:163
85198899170,3cyclictest939034-21df23:15:123
85198899170,15cyclictest889537-21latency_hist20:55:003
85198499178,7cyclictest935675-21cat23:05:172
851984991715,1cyclictest0-21swapper/223:26:412
851984991710,5cyclictest931458-21cron22:55:002
851984991710,5cyclictest931458-21cron22:55:002
851984991710,5cyclictest857985-21sort19:25:132
851982991715,1cyclictest3056-21PK-Backend19:23:551
851982991715,1cyclictest0-21swapper/123:28:101
851982991711,5cyclictest901804-21ls21:30:111
851982991710,5cyclictest888189-21expr20:50:131
85198299170,1cyclictest3056-21PK-Backend19:59:371
85198299170,1cyclictest3056-21PK-Backend19:59:371
851977991715,1cyclictest0-21swapper/023:14:170
851977991715,1cyclictest0-21swapper/021:23:240
851988991614,1cyclictest3056-21PK-Backend21:57:093
85198499164,11cyclictest919066-21sh22:20:002
851982991615,1cyclictest0-21swapper/119:50:241
851982991614,1cyclictest0-21swapper/100:21:031
851982991613,2cyclictest3056-21PK-Backend20:06:401
851982991612,2cyclictest889591-21/usr/sbin/munin20:55:171
851982991612,2cyclictest889591-21/usr/sbin/munin20:55:171
85198299160,1cyclictest3056-21PK-Backend22:09:491
851977991614,1cyclictest3056-21PK-Backend20:05:240
851977991612,3cyclictest904385-21switchtime21:35:220
851977991610,4cyclictest920325-21sed22:20:230
85198299156,7cyclictest956734-21cat00:05:181
851982991513,1cyclictest3056-21PK-Backend21:10:411
851982991512,2cyclictest3056-21PK-Backend00:32:391
851977991510,3cyclictest1095-21runrttasks19:20:090
851988991410,3cyclictest3056-21PK-Backend22:30:113
85198299149,3cyclictest879322-21sh20:25:121
851982991412,1cyclictest3056-21PK-Backend20:37:161
851982991410,3cyclictest3056-21PK-Backend22:12:441
851982991410,3cyclictest3056-21PK-Backend21:06:521
85197799130,12cyclictest3056-21PK-Backend22:35:420
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional