You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-23 - 06:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackcslot7s.osadl.org (updated Thu Apr 23, 2026 00:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
325829121360,3sleep2331rcuc/219:39:562
324588927945,23sleep20-21swapper/219:05:112
139099790,65rtkit-daemon0-21swapper/119:07:581
324585627343,20sleep30-21swapper/319:05:073
324628926242,13sleep00-21swapper/019:05:160
32998662610,11sleep234-21ksoftirqd/221:35:202
32550232540,2sleep20-21swapper/219:30:012
33022942500,2sleep10-21swapper/121:45:011
32755152440,4sleep10-21swapper/120:25:211
139099340,4rtkit-daemon1389-21rtkit-daemon19:33:122
324750199287,2cyclictest141rcu_preempt21:00:003
324749699271,24cyclictest3357253-21idleruntime-cro00:20:002
324749199270,7cyclictest3280563-21cut20:40:170
32704412250,5sleep23270442-21dump-pmu-power20:15:002
139099250,4rtkit-daemon1389-21rtkit-daemon23:54:353
139099250,4rtkit-daemon1389-21rtkit-daemon22:45:193
3247501992419,4cyclictest42-21ksoftirqd/323:50:003
3247491992412,10cyclictest3286561-21cron20:59:590
139099240,3rtkit-daemon1389-21rtkit-daemon23:16:442
3247496992318,4cyclictest3283645-21cat20:50:122
3247496992314,7cyclictest3252650-21ls19:20:202
3247491992321,1cyclictest0-21swapper/022:49:560
3247491992315,6cyclictest436-20systemd-journal20:30:000
139099230,3rtkit-daemon1389-21rtkit-daemon22:33:272
324750199227,3cyclictest3289601-21timerwakeupswit21:05:213
3247501992220,1cyclictest3056-21PK-Backend21:18:153
3247501992220,1cyclictest0-21swapper/323:36:383
3247501992219,2cyclictest3056-21PK-Backend23:40:433
3247501992215,5cyclictest3334408-21cron23:15:003
324750199220,20cyclictest3056-21PK-Backend21:56:403
3247496992220,1cyclictest0-21swapper/221:46:222
3247496992220,1cyclictest0-21swapper/220:25:242
3247496992220,1cyclictest0-21swapper/200:09:322
324749699220,21cyclictest0-21swapper/220:15:032
324749699220,20cyclictest0-21swapper/222:21:172
324749699220,20cyclictest0-21swapper/221:32:302
3247493992216,4cyclictest33523102sleep100:05:121
3247493992214,6cyclictest3297982-21ntp_states21:30:191
3247491992220,1cyclictest0-21swapper/023:54:110
3247491992220,1cyclictest0-21swapper/023:32:410
3247491992220,1cyclictest0-21swapper/023:28:350
3247491992220,1cyclictest0-21swapper/022:51:580
3247491992220,1cyclictest0-21swapper/021:28:240
3247491992220,1cyclictest0-21swapper/021:22:420
3247491992220,1cyclictest0-21swapper/020:02:120
3247491992215,5cyclictest436-20systemd-journal22:40:000
139099220,4rtkit-daemon1389-21rtkit-daemon00:16:163
139099220,3rtkit-daemon1389-21rtkit-daemon21:22:253
139099220,3rtkit-daemon1389-21rtkit-daemon21:20:462
33632012210,3sleep20-21swapper/200:35:162
33311012210,4sleep13056-21PK-Backend23:05:011
3247501992119,1cyclictest3056-21PK-Backend20:39:273
3247501992119,1cyclictest3056-21PK-Backend00:28:563
3247501992119,1cyclictest3056-21PK-Backend00:01:393
3247501992119,1cyclictest3056-21PK-Backend00:01:393
3247501992119,1cyclictest0-21swapper/323:30:293
3247501992119,1cyclictest0-21swapper/320:53:283
3247501992119,1cyclictest0-21swapper/300:14:093
3247501992118,2cyclictest3056-21PK-Backend22:39:053
3247501992118,2cyclictest3056-21PK-Backend19:24:313
3247501992117,2cyclictest3336417-21idleruntime-cro23:20:003
3247501992116,4cyclictest42-21ksoftirqd/322:45:013
3247501992112,7cyclictest3353787-21cron00:10:003
324750199210,20cyclictest3056-21PK-Backend22:57:173
324750199210,20cyclictest3056-21PK-Backend22:08:163
324750199210,19cyclictest3056-21PK-Backend19:13:223
3247496992119,1cyclictest0-21swapper/223:54:322
3247496992119,1cyclictest0-21swapper/223:33:362
3247496992119,1cyclictest0-21swapper/223:03:292
3247496992119,1cyclictest0-21swapper/222:43:482
3247496992119,1cyclictest0-21swapper/221:56:242
3247496992119,1cyclictest0-21swapper/221:44:192
3247496992119,1cyclictest0-21swapper/221:07:292
3247496992119,1cyclictest0-21swapper/220:56:542
3247496992119,1cyclictest0-21swapper/220:24:232
3247496992119,1cyclictest0-21swapper/200:30:552
3247496992119,1cyclictest0-21swapper/200:26:362
3247496992119,1cyclictest0-21swapper/200:21:162
3247496992119,1cyclictest0-21swapper/200:04:122
3247496992119,1cyclictest0-21swapper/200:04:122
324749399216,13cyclictest3357255-21sh00:20:001
3247493992119,1cyclictest0-21swapper/119:20:031
3247493992119,1cyclictest0-21swapper/100:25:161
3247493992118,2cyclictest0-21swapper/122:20:111
3247493992114,5cyclictest3310986-21date22:10:011
3247493992113,6cyclictest1-21systemd20:45:021
324749399210,19cyclictest3056-21PK-Backend23:38:591
324749399210,19cyclictest3056-21PK-Backend21:25:151
3247491992119,1cyclictest3056-21PK-Backend23:00:100
3247491992119,1cyclictest0-21swapper/022:11:090
3247491992119,1cyclictest0-21swapper/021:53:380
3247491992119,1cyclictest0-21swapper/021:39:590
3247491992119,1cyclictest0-21swapper/020:13:340
324749199210,20cyclictest0-21swapper/022:02:240
324749199210,20cyclictest0-21swapper/021:09:310
324749199210,20cyclictest0-21swapper/020:21:530
324749199210,20cyclictest0-21swapper/020:05:020
324749199210,20cyclictest0-21swapper/019:43:330
324749199210,20cyclictest0-21swapper/019:31:020
324749199210,20cyclictest0-21swapper/019:15:140
324749199210,1cyclictest0-21swapper/000:00:330
324749199210,1cyclictest0-21swapper/000:00:330
139099210,14rtkit-daemon0-21swapper/022:18:140
33446112200,3chrt0-21swapper/223:40:222
3247501992018,1cyclictest3056-21PK-Backend21:52:483
3247501992018,1cyclictest3056-21PK-Backend21:42:143
3247501992018,1cyclictest3056-21PK-Backend21:35:313
3247501992018,1cyclictest3056-21PK-Backend21:34:303
3247501992018,1cyclictest3056-21PK-Backend20:48:473
3247501992018,1cyclictest3056-21PK-Backend19:53:383
3247501992018,1cyclictest0-21swapper/322:53:123
3247501992018,1cyclictest0-21swapper/320:12:443
3247501992018,1cyclictest0-21swapper/320:08:523
3247501992018,1cyclictest0-21swapper/320:00:203
3247501992018,1cyclictest0-21swapper/319:59:203
3247501992017,2cyclictest3056-21PK-Backend22:27:023
3247501992015,3cyclictest3339501-21users23:25:223
3247501992012,6cyclictest3319329-21awk22:30:193
324750199200,7cyclictest3329975-21ntp_states23:00:193
324750199200,19cyclictest3056-21PK-Backend22:23:583
324750199200,19cyclictest3056-21PK-Backend20:27:323
324750199200,19cyclictest3056-21PK-Backend20:20:143
324750199200,19cyclictest0-21swapper/321:26:463
324750199200,19cyclictest0-21swapper/320:19:133
3247496992018,1cyclictest0-21swapper/223:58:512
3247496992018,1cyclictest0-21swapper/222:48:552
3247496992018,1cyclictest0-21swapper/220:46:202
3247496992018,1cyclictest0-21swapper/220:42:282
3247496992018,1cyclictest0-21swapper/220:09:092
3247496992018,1cyclictest0-21swapper/219:51:512
3247496992018,1cyclictest0-21swapper/219:46:102
3247496992016,3cyclictest1095-21runrttasks23:07:082
3247496992013,5cyclictest3347011-21cut23:50:012
324749699201,14cyclictest978-21snmpd00:10:122
324749699200,1cyclictest0-21swapper/222:29:282
324749699200,19cyclictest0-21swapper/222:51:592
324749699200,19cyclictest0-21swapper/222:39:422
324749699200,19cyclictest0-21swapper/222:18:132
324749699200,19cyclictest0-21swapper/222:09:142
324749699200,19cyclictest0-21swapper/221:53:182
324749699200,19cyclictest0-21swapper/221:17:022
324749699200,19cyclictest0-21swapper/219:57:332
324749699200,18cyclictest3249143-21perf19:15:002
324749399203,16cyclictest3263513-21latency_hist19:54:591
3247493992018,1cyclictest3056-21PK-Backend22:16:191
3247493992018,1cyclictest3056-21PK-Backend21:09:271
3247493992017,2cyclictest3056-21PK-Backend21:24:141
3247493992017,2cyclictest0-21swapper/120:50:481
3247493992013,5cyclictest3251360-21cron19:20:011
3247493992012,6cyclictest3317390-21cat22:25:171
324749399200,1cyclictest3056-21PK-Backend19:31:531
324749399200,19cyclictest3056-21PK-Backend22:33:021
324749399200,19cyclictest0-21swapper/121:37:401
324749399200,19cyclictest0-21swapper/121:19:341
324749399200,18cyclictest3056-21PK-Backend23:32:031
324749399200,18cyclictest3056-21PK-Backend23:25:061
324749399200,18cyclictest3056-21PK-Backend23:23:041
324749399200,18cyclictest3056-21PK-Backend21:01:561
324749399200,18cyclictest3056-21PK-Backend21:01:561
3247491992018,1cyclictest3056-21PK-Backend20:18:150
3247491992018,1cyclictest0-21swapper/022:55:030
3247491992018,1cyclictest0-21swapper/022:40:570
3247491992018,1cyclictest0-21swapper/022:30:560
3247491992018,1cyclictest0-21swapper/022:24:480
3247491992018,1cyclictest0-21swapper/021:02:010
3247491992018,1cyclictest0-21swapper/021:02:010
3247491992018,1cyclictest0-21swapper/019:57:320
3247491992018,1cyclictest0-21swapper/019:54:420
3247491992018,1cyclictest0-21swapper/019:46:230
3247491992018,1cyclictest0-21swapper/019:25:490
3247491992013,6cyclictest3336404-21cron23:20:000
324749199200,1cyclictest0-21swapper/021:57:300
324749199200,1cyclictest0-21swapper/021:32:160
324749199200,19cyclictest0-21swapper/023:24:300
324749199200,19cyclictest0-21swapper/021:45:550
324749199200,19cyclictest0-21swapper/021:41:010
324749199200,19cyclictest0-21swapper/020:36:390
324749199200,19cyclictest0-21swapper/020:33:490
324749199200,19cyclictest0-21swapper/000:37:030
139099200,16rtkit-daemon3247485-21cyclictest23:10:362
33544502190,4sleep00-21swapper/000:10:170
324750199196,2cyclictest141rcu_preempt20:45:003
3247501991917,1cyclictest3056-21PK-Backend22:04:243
3247501991917,1cyclictest0-21swapper/321:10:443
3247501991916,2cyclictest0-21swapper/321:01:113
3247501991916,2cyclictest0-21swapper/321:01:113
324750199191,16cyclictest3338190-21munin-run23:25:013
324750199190,7cyclictest3358262-21ntp_states00:20:193
324750199190,7cyclictest3257593-21ntp_states19:35:193
324750199190,1cyclictest3056-21PK-Backend21:45:043
324750199190,1cyclictest0-21swapper/323:56:183
3247496991917,1cyclictest0-21swapper/221:27:372
3247496991917,1cyclictest0-21swapper/221:11:212
3247496991917,1cyclictest0-21swapper/221:03:382
3247496991917,1cyclictest0-21swapper/221:03:372
3247496991917,1cyclictest0-21swapper/220:31:062
324749699190,1cyclictest0-21swapper/220:01:262
324749699190,1cyclictest0-21swapper/219:40:292
324749699190,18cyclictest0-21swapper/223:39:452
3247493991917,1cyclictest3056-21PK-Backend23:12:021
3247493991917,1cyclictest0-21swapper/122:03:411
3247493991917,1cyclictest0-21swapper/121:50:161
3247493991917,1cyclictest0-21swapper/120:46:081
3247493991917,1cyclictest0-21swapper/119:25:511
3247493991916,2cyclictest3056-21PK-Backend22:53:501
324749399190,1cyclictest3056-21PK-Backend23:04:521
324749399190,1cyclictest3056-21PK-Backend20:11:081
324749399190,1cyclictest3056-21PK-Backend00:14:481
324749399190,1cyclictest0-21swapper/100:33:271
324749399190,18cyclictest3056-21PK-Backend20:59:061
324749399190,18cyclictest3056-21PK-Backend20:15:461
324749399190,18cyclictest3056-21PK-Backend19:43:221
324749399190,18cyclictest0-21swapper/120:36:481
324749399190,18cyclictest0-21swapper/120:23:031
324749399190,18cyclictest0-21swapper/100:39:361
3247491991917,1cyclictest0-21swapper/022:07:170
3247491991917,1cyclictest0-21swapper/021:19:520
3247491991917,1cyclictest0-21swapper/020:53:300
324749199190,1cyclictest3056-21PK-Backend19:35:280
324749199190,1cyclictest0-21swapper/022:25:490
324749199190,1cyclictest0-21swapper/021:12:220
3247501991814,3cyclictest42-21ksoftirqd/319:30:013
3247501991814,2cyclictest3056-21PK-Backend00:35:183
3247501991813,3cyclictest3313457-21df22:15:143
3247501991813,3cyclictest3259327-21ntp_states19:40:193
3247501991813,3cyclictest3255861-21ntp_states19:30:193
324750199180,16cyclictest3331803-21memory23:05:173
3247496991816,1cyclictest0-21swapper/222:13:192
3247496991816,1cyclictest0-21swapper/220:36:472
324749699181,15cyclictest1095-21runrttasks22:55:092
3247496991810,6cyclictest3337265-21memory23:20:172
3247493991816,1cyclictest3056-21PK-Backend23:16:071
3247493991816,1cyclictest3056-21PK-Backend22:55:531
3247493991816,1cyclictest3056-21PK-Backend22:48:571
3247493991816,1cyclictest3056-21PK-Backend19:36:191
3247493991816,1cyclictest0-21swapper/123:42:031
3247493991816,1cyclictest0-21swapper/121:56:591
3247493991816,1cyclictest0-21swapper/121:45:231
3247493991816,1cyclictest0-21swapper/100:00:281
3247493991816,1cyclictest0-21swapper/100:00:281
3247493991815,2cyclictest3056-21PK-Backend20:04:381
3247493991811,5cyclictest3276314-21grep20:30:121
3247493991811,5cyclictest3264280-21cut19:55:171
324749399180,1cyclictest3056-21PK-Backend22:35:041
324749399180,1cyclictest0-21swapper/119:14:301
3247491991816,1cyclictest0-21swapper/023:40:520
3247491991816,1cyclictest0-21swapper/023:36:470
3247491991816,1cyclictest0-21swapper/023:05:170
3247491991816,1cyclictest0-21swapper/000:30:540
3247491991812,3cyclictest3252296-21needreboot19:20:170
3247491991811,5cyclictest3352724-21which00:05:160
3247501991714,2cyclictest3056-21PK-Backend19:46:213
324750199170,15cyclictest32773972sleep320:32:053
324749399178,7cyclictest3350302-21cron00:00:001
3247493991710,5cyclictest3311555-21tr22:10:121
3247491991716,1cyclictest0-21swapper/023:10:240
3247491991711,5cyclictest3360423-21seq00:26:240
3247491991711,4cyclictest3248084-21idleruntime19:10:130
324750199166,3cyclictest42-21ksoftirqd/322:12:333
3247501991614,1cyclictest3056-21PK-Backend19:15:463
3247501991611,4cyclictest42-21ksoftirqd/300:35:003
3247496991614,1cyclictest0-21swapper/222:04:202
3247496991610,5cyclictest3249717-21swap19:15:022
3247493991614,1cyclictest3056-21PK-Backend22:43:031
3247493991610,5cyclictest3261867-21cut19:50:021
324749199169,5cyclictest3348998-21cut23:55:110
3247491991614,1cyclictest0-21swapper/000:24:320
139099160,14rtkit-daemon0-21swapper/223:25:402
324749399152,11cyclictest3358991-21idleruntime-cro00:25:001
3247493991513,1cyclictest3056-21PK-Backend20:09:171
3247491991513,1cyclictest0-21swapper/020:47:000
324749399149,4cyclictest3056-21PK-Backend21:10:441
3247493991412,1cyclictest3056-21PK-Backend23:51:161
324749199149,3cyclictest3355770-21acpi00:15:100
3247493991311,1cyclictest3056-21PK-Backend23:45:071
324749199138,4cyclictest3346009-21needreboot23:45:170
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional