You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-25 - 07:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Thu Jun 25, 2026 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
418166821400,3sleep20-21swapper/219:40:332
2239612560,3sleep375-21kworker/3:1+events23:40:253
4146015995546,7cyclictest1704890-21systemd-journal23:30:002
4146015995546,7cyclictest1704890-21systemd-journal23:30:002
1052402520,3sleep00-21swapper/021:40:260
4146009995140,8cyclictest157715-21apt-get22:35:010
4146011994942,5cyclictest3497-21apt-get20:00:011
4146009994943,4cyclictest4104230-21kworker/u8:0+flush-8:019:10:190
4146011994838,7cyclictest82847-21latency_hist21:20:011
4146009994841,5cyclictest152734-21latency_hist22:30:000
4146009994742,4cyclictest112223-21kworker/u8:3+flush-8:022:45:310
4146015994641,4cyclictest34592-21kworker/u8:1+flush-8:021:00:312
4146011994636,8cyclictest1704890-21systemd-journal21:40:291
4146015994541,3cyclictest4167744-21kworker/u8:3+flush-8:019:50:392
4146011994436,7cyclictest4104230-21kworker/u8:0+flush-8:020:00:201
4146009994438,4cyclictest4167744-21kworker/u8:3+flush-8:020:30:350
4146009994437,5cyclictest4104230-21kworker/u8:0+flush-8:019:30:320
4146011994334,6cyclictest232304-21latency_hist23:50:011
4146009994337,4cyclictest4183189-21kworker/u8:2+flush-8:020:45:210
4146009994334,7cyclictest4167744-21kworker/u8:3+flush-8:019:55:360
4146009994332,10cyclictest217446-21kworker/u8:0+events_unbound23:40:320
4146015994235,4cyclictest112223-21kworker/u8:3+flush-8:022:55:362
4146009994238,3cyclictest4155660-21kworker/u8:1+flush-8:019:25:190
4146009994235,5cyclictest112223-21kworker/u8:3+flush-8:023:00:310
4146015994135,4cyclictest4183189-21kworker/u8:2+flush-8:020:30:202
4146011994135,4cyclictest4104230-21kworker/u8:0+flush-8:019:30:201
4146009994136,4cyclictest34592-21kworker/u8:1+events_unbound21:05:230
4146009994131,7cyclictest212482-21latency_hist23:30:010
4146009994131,7cyclictest212482-21latency_hist23:30:000
4146011994033,5cyclictest182727-21latency_hist23:00:011
4146009994036,3cyclictest112223-21kworker/u8:3+flush-8:023:35:310
4146009994035,3cyclictest102393-21kworker/u8:0+flush-8:022:00:360
4146009993934,4cyclictest4104230-21kworker/u8:0+flush-8:020:25:340
4146009993931,5cyclictest43879-21diskstats20:40:200
4146009993930,7cyclictest63334-21/usr/sbin/munin21:00:250
4146009993929,8cyclictest246497-21ntpq00:00:270
4146011993831,5cyclictest212747-21apt-get23:30:141
4146011993829,7cyclictest1704890-21systemd-journal00:10:011
4146011993829,7cyclictest112877-21/usr/sbin/munin21:50:281
4146009993828,9cyclictest127213-21kworker/u8:2+flush-8:023:05:360
414562723726,6sleep10-21swapper/119:07:341
4146015993632,3cyclictest2674899-21kworker/u8:2+flush-8:019:20:322
4146011993632,3cyclictest242433-21kworker/u8:1+flush-8:000:35:281
4146011993631,3cyclictest102393-21kworker/u8:0+flush-8:022:45:161
4146011993630,5cyclictest246646-21kworker/u8:4+flush-8:000:15:311
4146011993629,6cyclictest4104230-21kworker/u8:0+flush-8:020:15:311
4146009993630,4cyclictest112903-21apt-get21:50:160
4146015993523,9cyclictest1704890-21systemd-journal23:10:002
4146011993530,4cyclictest4183189-21kworker/u8:2+flush-8:020:45:341
4146011993529,4cyclictest112223-21kworker/u8:3+flush-8:000:00:311
4146009993529,4cyclictest4183189-21kworker/u8:2+flush-8:020:35:300
4146009993529,4cyclictest3795193-21kworker/u8:3+events_unbound19:15:050
4146015993430,3cyclictest4167744-21kworker/u8:3+events_unbound21:15:372
4146015993429,4cyclictest4167744-21kworker/u8:3+flush-8:021:30:312
4146011993429,4cyclictest34592-21kworker/u8:1+events_unbound20:30:271
4146011993426,6cyclictest1704890-21systemd-journal21:14:471
4146009993430,3cyclictest237281-21base6423:55:010
4146009993427,6cyclictest127213-21kworker/u8:2+flush-8:023:45:320
4146009993424,8cyclictest276624-21ntpq00:30:280
4146015993329,3cyclictest4167744-21kworker/u8:3+events_unbound21:10:352
4146011993329,3cyclictest34592-21kworker/u8:1+flush-8:020:35:351
4146011993329,3cyclictest277177-21unixbench_singl00:30:361
4146011993325,6cyclictest227349-21latency_hist23:45:021
4146009993331,1cyclictest34592-21kworker/u8:1+events_unbound21:25:330
4146009993328,4cyclictest4167744-21kworker/u8:3+events_unbound21:30:290
4146009993327,4cyclictest4167744-21kworker/u8:3+flush-8:019:50:340
4146009993327,4cyclictest127213-21kworker/u8:2+events_unbound23:15:190
4146011993227,3cyclictest141625-21needreboot22:15:281
4146011993224,6cyclictest4192093-21unixbench_singl19:50:371
4146011993224,6cyclictest4177606-21cron19:40:001
4146011993221,8cyclictest1704890-21systemd-journal20:56:471
4146011993221,8cyclictest1704890-21systemd-journal20:56:471
4146009993227,3cyclictest102393-21kworker/u8:0+flush-8:022:10:350
41456652324,9sleep20-21swapper/219:08:032
4146015993125,4cyclictest4183189-21kworker/u8:2+events_unbound21:20:362
4146015993124,5cyclictest3497-21apt-get20:00:012
4146011993126,3cyclictest93712-21irqrtprio21:30:231
4146011993126,3cyclictest29459-21irqrtprio20:25:241
4146011993125,4cyclictest127213-21kworker/u8:2+events_unbound23:35:171
4146009993127,3cyclictest192657-21kworker/u8:0+events_unbound23:10:220
4146009993124,5cyclictest4104230-21kworker/u8:0+flush-8:020:05:360
4146009993122,6cyclictest257520-21latency_hist00:15:020
414600999311,12cyclictest41610102kthreadcore19:20:260
4146015993026,2cyclictest4153105-21aten2_r5power_c19:15:172
4146015993024,4cyclictest237648-21cp23:55:012
4146015993024,4cyclictest112223-21kworker/u8:3+flush-8:022:00:312
4146015993021,7cyclictest1704890-21systemd-journal23:44:472
4146011993027,2cyclictest85288-21kthreadcore21:20:261
4146011993024,4cyclictest202855-21apt-get23:20:161
4146011993023,5cyclictest153217-21cpuspeed_turbos22:30:201
4146011993022,6cyclictest163163-21/usr/sbin/munin22:40:271
4146011993021,7cyclictest158186-21/usr/sbin/munin22:35:281
4146009993026,3cyclictest112223-21kworker/u8:3+flush-8:022:09:170
4146009993026,2cyclictest23489-21cron20:19:590
4146009993025,3cyclictest401-21dbus-daemon22:00:000
4146009993025,3cyclictest24510-21irqrtprio20:20:240
4146009993024,5cyclictest4155660-21kworker/u8:1+flush-8:019:40:220
4146009993024,4cyclictest143162-21fschecks_count22:20:210
4146009993023,5cyclictest20977-21cron20:15:000
53002290,9sleep375-21kworker/3:1+mm_percpu_wq20:00:253
4146015992925,2cyclictest162462-21unixbench_multi22:35:362
4146015992924,4cyclictest102393-21kworker/u8:0+flush-8:022:15:302
4146015992924,3cyclictest257125-21unixbench_singl00:10:352
4146011992923,4cyclictest2674899-21kworker/u8:2+flush-8:019:20:351
4146011992922,5cyclictest4153664-21irqcore19:15:221
4146011992922,5cyclictest4104230-21kworker/u8:0+flush-8:020:10:201
4146011992921,6cyclictest1704890-21systemd-journal21:25:271
4146009992925,3cyclictest83842-21irqrtprio21:20:250
4146009992925,3cyclictest1-21systemd00:20:000
4146009992925,2cyclictest0-21swapper/021:15:010
4146009992924,3cyclictest167873-21cron22:44:590
4146009992922,5cyclictest207148-21grep23:20:360
41627692280,4chrt75-21kworker/3:1+events19:25:003
4146015992824,3cyclictest4183189-21kworker/u8:2+events_unbound20:50:302
4146015992824,3cyclictest4183189-21kworker/u8:2+events_unbound20:50:292
4146015992824,2cyclictest272920-21aten2_r5power_c00:30:182
4146015992817,9cyclictest247400-21apt-get00:05:032
4146011992825,2cyclictest123428-21irqcore22:00:251
4146011992823,4cyclictest127213-21kworker/u8:2+events_unbound23:50:211
4146011992823,3cyclictest177790-21kworker/u8:1+events_unbound23:00:241
4146011992821,5cyclictest102393-21kworker/u8:0+flush-8:021:55:311
4146011992820,6cyclictest252851-21apt-get00:10:151
4146009992825,2cyclictest272187-21unixbench_multi00:25:370
4146009992822,4cyclictest78459-21fschecks_count21:15:200
4146009992822,4cyclictest58129-21cron20:55:000
4146009992822,4cyclictest58129-21cron20:54:590
4146009992821,5cyclictest242387-21latency_hist00:00:020
4146015992724,2cyclictest192990-21aten2_r5power_p23:10:172
4146015992722,4cyclictest246646-21kworker/u8:4+flush-8:000:20:312
4146015992722,4cyclictest217446-21kworker/u8:0+events_unbound00:00:312
4146015992715,9cyclictest1704890-21systemd-journal22:25:002
4146011992723,3cyclictest47861-21unixbench_multi20:40:361
4146011992723,3cyclictest4167327-21unixbench_singl19:25:351
4146011992722,4cyclictest133089-21aten2_r5power_p22:10:161
4146011992721,4cyclictest63444-21aten2_r5power_p21:00:161
4146011992720,5cyclictest1704890-21systemd-journal23:25:471
4146011992720,5cyclictest1704890-21systemd-journal23:25:461
4146009992721,4cyclictest213061-21fschecks_time23:30:200
4146009992721,4cyclictest102393-21kworker/u8:0+flush-8:022:35:290
4146009992720,5cyclictest1704890-21systemd-journal22:55:000
4146009992718,7cyclictest108282-21fschecks_count21:45:210
4146015992623,2cyclictest231857-21unixbench_multi23:45:352
4146015992622,3cyclictest4104230-21kworker/u8:0+events_unbound19:30:012
4146015992622,2cyclictest278750-21kthreadcore00:35:232
4146015992620,4cyclictest177790-21kworker/u8:1+flush-8:023:00:042
4146015992617,7cyclictest1704890-21systemd-journal21:53:472
4146011992623,2cyclictest4182539-21cron19:45:001
4146011992622,3cyclictest152350-21unixbench_singl22:25:361
4146011992621,3cyclictest202186-21unixbench_singl23:15:361
4146011992620,5cyclictest4104230-21kworker/u8:0+flush-8:019:10:301
4146009992621,4cyclictest4104230-21kworker/u8:0+flush-8:019:45:200
4146009992620,4cyclictest252577-21cron00:10:010
4146009992619,5cyclictest98132-21wget21:35:180
4146009992618,5cyclictest267696-21latency_hist00:25:020
4146015992521,2cyclictest3050-21unixbench_multi19:55:372
4146015992520,4cyclictest127213-21kworker/u8:2+flush-8:022:25:472
4146015992520,3cyclictest4173873-21kthreadcore19:35:242
4146015992520,3cyclictest168369-21cpuspeed_turbos22:45:172
4146011992520,3cyclictest190779-21kthreadcore23:05:261
4146011992520,3cyclictest102292-21unixbench_multi21:35:351
4146011992520,3cyclictest0-21swapper/100:00:021
4146011992519,4cyclictest71405-21kthreadcore21:05:261
4146009992520,3cyclictest4173172-21cpuspeed_turbos19:35:200
4146009992520,3cyclictest182715-21cron22:59:590
4146009992519,4cyclictest138312-21fschecks_time22:15:210
4146015992421,2cyclictest9010-21aten2_r5power_c20:05:172
4146015992420,2cyclictest167485-21unixbench_singl22:40:362
4146011992420,3cyclictest263744-21irqrtprio00:20:231
4146011992420,2cyclictest0-21swapper/122:05:301
4146011992420,2cyclictest0-21swapper/121:45:281
4146011992417,5cyclictest9123-21cpu20:05:181
4146011992415,7cyclictest267958-21apt-get00:25:161
4146009992418,4cyclictest4286-21fschecks_count20:00:190
4146015992318,3cyclictest102287-21unixbench_multi21:35:352
4146015992314,6cyclictest1704890-21systemd-journal23:17:002
4146011992318,3cyclictest0-21swapper/122:25:001
4146011992317,5cyclictest57726-21unixbench_multi20:50:371
4146011992317,5cyclictest57726-21unixbench_multi20:50:361
4146011992317,4cyclictest28470-21latency_hist20:25:001
4146011992316,6cyclictest4187074-21unixbench_multi19:45:351
4146011992316,5cyclictest174820-21kthreadcore22:50:251
4146015992219,2cyclictest43660-21aten2_r5power_c20:40:172
4146015992218,3cyclictest92328-21unixbench_singl21:25:342
4146015992218,2cyclictest23816-21aten2_r5power_c20:20:192
4146009992217,4cyclictest246646-21kworker/u8:4+flush-8:000:35:360
41457552222,14sleep00-21swapper/019:09:140
414601599219,4cyclictest0-21swapper/222:10:142
4146015992113,5cyclictest272627-21cat00:30:012
4146011992116,3cyclictest192657-21kworker/u8:0+flush-8:023:10:251
4146009992116,3cyclictest58699-21fschecks_count20:55:210
4146009992116,3cyclictest58699-21fschecks_count20:55:210
414601599203,3cyclictest185522idleruntime-cro20:15:002
414601599200,19cyclictest1-21systemd00:20:012
414601599192,12cyclictest4182817-21apt-get19:45:182
414601599192,12cyclictest4146164-21apt-get19:10:172
414601599192,12cyclictest28740-21apt-get20:25:182
4146015991912,4cyclictest1704890-21systemd-journal00:00:012
414601599190,7cyclictest615072cut20:55:282
414601599190,7cyclictest615072cut20:55:272
414752180,3sleep2371rcuc/220:35:272
4146015991814,2cyclictest0-21swapper/221:45:002
4146015991812,4cyclictest0-21swapper/222:05:262
4146015991810,6cyclictest110975-21tr21:45:272
41417262183,8sleep30-21swapper/319:05:233
2402842180,2sleep3471rcuc/323:55:263
414601599176,9cyclictest20789-21tr20:15:262
414601599174,4cyclictest2134192irqcore23:30:222
4146015991713,2cyclictest0-21swapper/223:20:232
4146015991713,2cyclictest0-21swapper/222:30:242
4146015991713,2cyclictest0-21swapper/220:45:312
4146015991712,3cyclictest0-21swapper/221:05:172
414601599171,11cyclictest217684-21apt-get23:35:172
414601599167,7cyclictest4171353-21tr19:30:252
4146015991612,2cyclictest177363-21unixbench_singl22:50:362
4146015991510,3cyclictest0-21swapper/221:55:232
345782156,5sleep30-21swapper/320:30:233
1211162150,2sleep3471rcuc/321:55:263
1475722142,7sleep30-21swapper/322:25:013
41627692132,6sleep30-21swapper/319:25:023
2726492132,6sleep30-21swapper/300:30:023
2223852132,6sleep30-21swapper/323:40:013
1629892132,6sleep30-21swapper/322:40:023
934932122,6sleep30-21swapper/321:30:233
920662122,6sleep30-21swapper/321:25:333
869992122,6sleep30-21swapper/321:20:363
779252122,6sleep30-21swapper/321:15:023
768292122,6sleep30-21swapper/321:10:293
729142123,5sleep30-21swapper/321:09:153
659522122,6sleep30-21swapper/321:00:253
534582122,6sleep30-21swapper/320:50:183
534582122,6sleep30-21swapper/320:50:183
440572122,6sleep30-21swapper/320:40:223
41893482122,6sleep30-21swapper/319:50:253
41869032122,6sleep30-21swapper/319:45:373
41819302122,6sleep30-21swapper/319:40:393
41731962122,6sleep30-21swapper/319:35:203
41511202122,5sleep30-21swapper/319:15:033
31602122,6sleep30-21swapper/319:55:483
2777972123,6sleep30-21swapper/300:35:163
2573802122,6sleep30-21swapper/300:13:253
2474172122,5sleep30-21swapper/300:05:013
2426852122,6sleep30-21swapper/300:00:163
2132192122,6sleep30-21swapper/323:30:233
2075092120,7sleep30-21swapper/323:25:003
1972002122,6sleep30-21swapper/323:10:363
190842122,6sleep30-21swapper/320:15:223
1883212122,6sleep30-21swapper/323:05:213
1728082122,5sleep30-21swapper/322:50:003
1723552122,6sleep30-21swapper/322:45:363
1584642122,6sleep30-21swapper/322:35:203
1533762122,6sleep30-21swapper/322:30:223
1483312122,6sleep30-21swapper/322:25:213
1377202122,5sleep30-21swapper/322:15:013
1367462122,6sleep30-21swapper/322:10:283
1296092122,6sleep30-21swapper/322:05:273
1233042122,6sleep30-21swapper/322:00:243
1126502122,5sleep30-21swapper/321:50:023
1114342122,6sleep30-21swapper/321:45:283
1028402122,6sleep30-21swapper/321:40:013
1017442122,6sleep30-21swapper/321:35:293
89962112,5sleep30-21swapper/320:05:193
584372112,5sleep30-21swapper/320:55:203
584372112,5sleep30-21swapper/320:55:193
487242112,5sleep30-21swapper/320:45:193
41681862112,5sleep30-21swapper/319:30:203
41465332112,5sleep30-21swapper/319:10:213
391832112,5sleep30-21swapper/320:35:253
284962112,5sleep30-21swapper/320:25:013
2679322112,5sleep30-21swapper/300:25:163
2630822112,5sleep30-21swapper/300:20:193
2588662112,5sleep30-21swapper/300:15:253
237542112,6sleep30-21swapper/320:20:163
2334572112,5sleep30-21swapper/323:50:243
2309862112,5sleep30-21swapper/323:45:273
2102132112,5sleep30-21swapper/323:25:253
2102132112,5sleep30-21swapper/323:25:253
1976452112,5sleep30-21swapper/323:15:013
1829892112,5sleep30-21swapper/323:00:173
1783862112,5sleep30-21swapper/322:55:233
141912112,5sleep30-21swapper/320:10:203
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional