You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-19 - 07:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Fri Jun 19, 2026 00:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
137238923730,2sleep3481ktimers/319:50:283
144044323520,5sleep30-21swapper/320:59:223
147660021510,2sleep3471rcuc/321:35:313
1329179998373,7cyclictest1361364-21latency_hist19:40:020
15062872620,3sleep01506293-21kthreadcore22:05:290
1329179996256,4cyclictest1395090-21ntpq20:10:350
1329179996252,7cyclictest1633809-21apt-get00:15:000
1329187996052,6cyclictest1480400-21cat21:40:012
1329187995751,4cyclictest1361622-21kworker/u8:2+flush-8:020:10:362
1329181995749,5cyclictest1599176-21latency_hist23:40:001
1329179995747,8cyclictest1376755-21diskstats19:55:250
1329179995648,6cyclictest1543727-21ntpq22:40:370
1329187995550,4cyclictest1410055-21kworker/u8:1+flush-8:022:25:312
1329179995444,8cyclictest1618034-21ntpq23:55:350
1329181995246,4cyclictest1334201-21gpgv19:15:001
1329179995243,7cyclictest1459478-21ntpq21:15:400
1329181995145,4cyclictest1371507-21kworker/u8:4+flush-8:021:30:331
1329179995145,4cyclictest1485514-21kworker/u8:0+flush-8:021:45:300
1329179995142,6cyclictest1434682-21ntpq20:50:360
1329179995141,7cyclictest1370348-21ntpq19:45:340
1329179994942,5cyclictest1386436-21/usr/sbin/munin20:05:320
1329179994940,7cyclictest1642999-21ntpq00:20:350
1329187994840,5cyclictest1465367-21cp21:25:002
1329181994838,8cyclictest1454499-21ntpq21:10:371
1329179994840,6cyclictest1704890-21systemd-journal23:22:380
1329179994834,12cyclictest1334176-21apt-get19:15:010
1329187994743,3cyclictest1371500-21kworker/u8:3+flush-8:019:50:312
1329187994741,4cyclictest1485514-21kworker/u8:0+events_unbound22:15:342
1329181994736,8cyclictest1346759-21/usr/sbin/munin19:25:311
1329181994639,5cyclictest1545122-21diskstats22:45:261
1329181994637,7cyclictest1638118-21ntpq00:15:361
1329187994539,4cyclictest1371507-21kworker/u8:4+flush-8:023:35:352
1329179994535,8cyclictest1568369-21ntpq23:05:330
1329187994434,8cyclictest1704890-21systemd-journal22:25:012
1329181994439,3cyclictest1499249-21ntpq21:55:351
1329187994338,4cyclictest1371507-21kworker/u8:4+flush-8:020:15:392
1329181994335,6cyclictest1475674-21apt-get21:35:221
1329181994335,6cyclictest1371547-21apt-get19:50:211
1329179994334,7cyclictest1608194-21ntpq23:45:360
1329187994237,4cyclictest1361622-21kworker/u8:2+flush-8:019:40:372
1329181994230,9cyclictest1704890-21systemd-journal00:22:201
1329179994231,8cyclictest1465268-21latency_hist21:25:000
1329181994131,8cyclictest1464390-21ntpq21:20:371
1329181994030,8cyclictest1504166-21ntpq22:00:381
1329181994027,10cyclictest1704890-21systemd-journal22:29:201
1329187993934,4cyclictest1328910-21kworker/u8:0+flush-8:019:20:272
1329181993932,5cyclictest1510244-21apt-get22:10:211
1329181993932,5cyclictest1440800-21apt-get21:00:231
1329181993932,5cyclictest1356404-21latency_hist19:35:021
1329181993931,5cyclictest1495154-21latency_hist21:55:011
1329181993931,5cyclictest1495154-21latency_hist21:55:001
1329179993932,5cyclictest1410055-21kworker/u8:1+flush-8:021:40:300
1329179993832,4cyclictest1276687-21kworker/u8:1+events_unbound19:15:030
1329179993831,5cyclictest1336441-21kworker/u8:2+events_unbound19:25:380
1329179993829,7cyclictest1436095-21diskstats20:55:270
1329179993829,7cyclictest1429771-21ntpq20:45:330
1329179993829,7cyclictest1409937-21ntpq20:25:330
1329179993827,8cyclictest1371507-21kworker/u8:4+flush-8:020:35:380
1329187993731,4cyclictest1371507-21kworker/u8:4+events_unbound21:45:432
1329181993730,5cyclictest1341329-21latency_hist19:20:011
1329181993725,9cyclictest1484354-21ntpq21:40:341
1329179993725,10cyclictest1578279-21ntpq23:15:350
1329187993631,4cyclictest1404175-21kworker/u8:0+events_unbound20:20:422
1329181993630,4cyclictest1336441-21kworker/u8:2+flush-8:019:21:251
1329179993629,5cyclictest1371507-21kworker/u8:4+flush-8:020:20:260
1329179993627,7cyclictest1634564-21diskstats00:15:260
1329179993627,6cyclictest1346512-21latency_hist19:25:010
132881223621,10sleep10-21swapper/119:09:261
1329187993531,2cyclictest1371507-21kworker/u8:4+flush-8:022:40:332
1329181993528,5cyclictest1704890-21systemd-journal22:54:201
1329179993527,6cyclictest1371507-21kworker/u8:4+flush-8:022:50:360
1329187993424,8cyclictest1495149-21cat21:55:002
1329187993424,8cyclictest1495149-21cat21:55:002
1329181993428,4cyclictest1371507-21kworker/u8:4+flush-8:020:30:451
1329179993427,6cyclictest1485514-21kworker/u8:0+flush-8:021:50:310
1329179993427,6cyclictest1485514-21kworker/u8:0+flush-8:021:50:300
1329179993425,7cyclictest1623117-21ntpq00:00:380
1329179993425,7cyclictest1385313-21ntpq20:00:340
1329181993328,3cyclictest1426696-21irqrtprio20:45:281
1329181993327,1cyclictest161rcu_preempt20:10:011
1329181993326,5cyclictest1593331-21ntpq23:30:361
1329181993326,4cyclictest1523864-21strings22:20:341
1329181993325,6cyclictest1544596-21latency_hist22:45:001
1329179993327,4cyclictest1524293-21kworker/u8:2+events_unbound23:25:410
1329179993326,5cyclictest1421043-21/usr/sbin/munin20:40:380
1329179993326,5cyclictest1371507-21kworker/u8:4+flush-8:021:55:500
1329179993325,5cyclictest1475405-21latency_hist21:35:010
152978423222,5sleep30-21swapper/322:30:023
1329187993227,3cyclictest1361622-21kworker/u8:2+flush-8:019:45:312
1329187993226,5cyclictest1336441-21kworker/u8:2+flush-8:019:31:242
1329187993224,5cyclictest1549803-21apt-get22:50:212
1329181993227,4cyclictest1410055-21kworker/u8:1+flush-8:022:30:371
1329181993227,3cyclictest401-21dbus-daemon20:00:011
1329181993216,2cyclictest0-21swapper/120:40:301
1329179993228,3cyclictest1410055-21kworker/u8:1+events_unbound23:10:240
1329179993226,4cyclictest1371507-21kworker/u8:4+events_unbound22:35:300
1329179993225,5cyclictest1624209-21sshd00:05:200
13282882322,26sleep20-21swapper/219:05:422
1329187993127,3cyclictest1371507-21kworker/u8:4+flush-8:021:30:462
1329187993123,6cyclictest1704890-21systemd-journal00:26:192
1329181993127,3cyclictest1410055-21kworker/u8:1+flush-8:022:37:251
1329181993123,6cyclictest1704890-21systemd-journal23:26:201
1329187993025,3cyclictest1376563-21aten2_r5power_e19:55:232
1329181993027,2cyclictest1565194-21irqcore23:05:281
1329181992925,2cyclictest1445957-21cpuspeed_turbos21:05:241
1329181992912,9cyclictest1647398-21cut00:25:341
1329181992912,9cyclictest1394052-21cut20:10:321
132918199290,13cyclictest1629171-21apt-get00:10:221
132917999293,10cyclictest0-21swapper/021:00:240
1329179992923,4cyclictest1485514-21kworker/u8:0+events_unbound22:10:410
1329179992922,5cyclictest1454978-21grep21:10:430
1329179992920,6cyclictest1530047-21/usr/sbin/munin22:30:340
1329187992824,3cyclictest1549096-21unixbench_multi22:45:412
1329187992824,3cyclictest1410055-21kworker/u8:1+flush-8:021:15:372
1329187992824,2cyclictest1649193-21aten2_r5power_c00:30:252
1329187992823,4cyclictest1336441-21kworker/u8:2+events_unbound19:30:012
1329187992822,5cyclictest1371507-21kworker/u8:4+flush-8:022:35:412
1329187992822,4cyclictest1633370-21unixbench_multi00:10:422
1329187992821,5cyclictest1371507-21kworker/u8:4-events_unbound00:00:002
1329187992820,5cyclictest1609380-21apt-get23:50:222
1329181992823,3cyclictest0-21swapper/123:45:011
1329181992821,4cyclictest0-21swapper/123:45:371
1329181992820,3cyclictest161rcu_preempt23:10:321
1329179992824,3cyclictest1371507-21kworker/u8:4+flush-8:021:25:310
1329179992823,4cyclictest1361622-21kworker/u8:2+events_unbound20:15:230
1329179992822,4cyclictest1704890-21systemd-journal22:20:010
1329179992822,4cyclictest1410055-21kworker/u8:1+events_unbound23:00:000
132918199277,6cyclictest1615740-21cut23:55:311
1329181992719,6cyclictest1490242-21latency_hist21:50:011
1329179992721,4cyclictest1658790-21systemd-run00:39:590
1329179992721,4cyclictest1613629-21unixbench_multi23:50:430
1329179992721,4cyclictest1563899-21unixbench_multi23:00:430
14446672260,6sleep3451irq_work/321:00:393
1329187992621,4cyclictest1356277-21kworker/u8:1+flush-8:019:35:372
1329187992621,3cyclictest1579765-21fschecks_count23:20:252
1329187992621,3cyclictest1470465-21kworker/u8:2+events_unbound21:30:002
1329187992617,7cyclictest1704890-21systemd-journal00:25:002
1329187992615,8cyclictest1579176-21awk23:20:002
132918199266,8cyclictest0-21swapper/100:35:011
132918199265,7cyclictest1467273-21cut21:25:301
1329181992622,2cyclictest1555439-21irqrtprio22:55:301
1329181992621,3cyclictest1560414-21irqrtprio23:00:301
1329181992621,3cyclictest1459898-21grep21:15:431
1329181992621,2cyclictest0-21swapper/123:15:411
1329181992618,6cyclictest1579474-21apt-get23:20:221
1329181992618,2cyclictest161rcu_preempt20:25:361
1329181992616,7cyclictest1704890-21systemd-journal23:51:201
1329181992614,9cyclictest1419841-21ntpq20:35:331
1329179992620,5cyclictest1524293-21kworker/u8:2+flush-8:023:30:360
1329179992619,5cyclictest401-21dbus-daemon20:35:000
1329187992521,3cyclictest1568913-21unixbench_singl23:05:422
132918799251,8cyclictest13889041kthreadcore20:05:292
132918199255,6cyclictest1432475-21cut20:50:311
1329181992517,2cyclictest161rcu_preempt22:05:301
1329181992515,7cyclictest1401282-21apt-get20:20:211
1329181992510,8cyclictest161rcu_preempt00:04:241
132918199250,14cyclictest1366344-21/usr/sbin/munin19:45:011
1329179992521,3cyclictest1371507-21kworker/u8:4+events_unbound22:20:380
1329179992520,3cyclictest1371507-21kworker/u8:4+events_unbound00:30:330
1329179992520,3cyclictest0-21swapper/021:10:000
1329179992519,4cyclictest1371507-21kworker/u8:4+events_unbound22:45:400
1329187992421,2cyclictest1495716-21fschecks_count21:55:232
1329181992420,2cyclictest0-21swapper/120:15:321
1329181992420,2cyclictest0-21swapper/100:35:341
132918199241,8cyclictest1519513-21head22:15:431
132918199240,9cyclictest1361419-21latency_hist19:40:011
132917999242,21cyclictest1470460-21kworker/0:0+events21:35:420
1329179992420,2cyclictest1355428-21needreboot19:30:330
1329179992419,4cyclictest1375818-21unixbench_multi19:50:410
1329179992419,3cyclictest1704890-21systemd-journal23:40:000
1329179992416,6cyclictest1704890-21systemd-journal00:30:000
1329179992413,9cyclictest1704890-21systemd-journal23:45:000
1329187992319,3cyclictest1410055-21kworker/u8:1+events_unbound20:25:392
1329187992318,4cyclictest1509573-21unixbench_singl22:05:422
1329187992318,4cyclictest1410055-21kworker/u8:1+events_unbound20:54:302
1329187992315,6cyclictest1704890-21systemd-journal20:03:202
132918199238,7cyclictest0-21swapper/119:45:221
132918199238,3cyclictest161rcu_preempt20:00:261
132918199235,11cyclictest30-21ksoftirqd/120:55:261
1329181992319,2cyclictest0-21swapper/100:05:251
15290042220,19sleep01529067-21/usr/sbin/munin22:25:410
132918799223,13cyclictest1411154-21apt-get20:30:232
1329187992218,2cyclictest0-21swapper/222:35:002
1329187992218,2cyclictest0-21swapper/200:05:002
1329187992214,6cyclictest1554718-21apt-get22:55:222
1329179992215,5cyclictest1371507-21kworker/u8:4+flush-8:022:00:320
1329179992215,5cyclictest1328910-21kworker/u8:0+events_unbound19:45:000
1329187992117,2cyclictest1624458-21cpuspeed_turbos00:05:262
1329187992117,2cyclictest0-21swapper/219:15:012
132918799202,13cyclictest1445733-21apt-get21:05:242
1329187992017,2cyclictest1563886-21unixbench_multi23:00:422
1329187992017,2cyclictest1416315-21cpuspeed_turbos20:35:242
1329187992016,2cyclictest0-21swapper/200:40:002
1329187992014,4cyclictest1430223-21unixbench_multi20:45:402
1329187992014,4cyclictest0-21swapper/223:10:282
16233142190,3sleep375-21kworker/3:1+events00:00:423
1329187991915,2cyclictest1634539-21cpuspeed_turbos00:15:252
13242762193,8sleep00-21swapper/019:05:230
13241972193,8sleep30-21swapper/319:05:023
1329187991814,3cyclictest1371507-21kworker/u8:4+flush-8:022:00:372
1329187991814,2cyclictest1584633-21cpuspeed_turbos23:25:252
14111562172,10sleep30-21swapper/320:30:233
132918799173,10cyclictest1593322-21ntpq23:30:362
132918799172,11cyclictest1333255-21ntpq19:10:352
1329187991713,2cyclictest1422476-21kthreadcore20:40:312
1329187991713,2cyclictest0-21swapper/221:10:292
1329187991712,3cyclictest0-21swapper/223:40:322
132918799163,7cyclictest1480627-21apt-get21:40:232
1329187991612,2cyclictest0-21swapper/220:55:362
1329187991611,3cyclictest0-21swapper/221:00:302
16093832152,8sleep30-21swapper/323:50:243
132918799151,2cyclictest16062391kthreadcore23:45:322
1329187991510,3cyclictest0-21swapper/222:10:302
13342942142,7sleep30-21swapper/319:15:013
16396722132,7sleep30-21swapper/300:20:293
15637502134,5sleep30-21swapper/323:00:443
15498742132,7sleep30-21swapper/322:50:233
15199312132,6sleep30-21swapper/322:20:023
14457072132,7sleep30-21swapper/321:05:223
14012882132,7sleep30-21swapper/320:20:223
13903302132,7sleep30-21swapper/320:05:383
13654542132,7sleep30-21swapper/319:40:383
13294492132,7sleep30-21swapper/319:10:253
16543802122,6sleep30-21swapper/300:35:263
16532182122,6sleep30-21swapper/300:30:443
16488202122,6sleep30-21swapper/300:29:203
16293322123,6sleep30-21swapper/300:10:253
16253612123,5sleep30-21swapper/300:05:333
16140532122,5sleep30-21swapper/323:55:003
16044312122,6sleep30-21swapper/323:45:263
15998392122,6sleep30-21swapper/323:40:273
15958702123,5sleep30-21swapper/323:35:313
15914092123,5sleep30-21swapper/323:30:333
15830632122,6sleep30-21swapper/323:20:333
15745232122,6sleep30-21swapper/323:15:243
15728612122,6sleep30-21swapper/323:10:353
15578692122,6sleep30-21swapper/322:55:343
15451232122,6sleep30-21swapper/322:45:273
14905212122,6sleep30-21swapper/321:50:253
14905212122,6sleep30-21swapper/321:50:253
14803652122,5sleep30-21swapper/321:40:013
14695342122,6sleep30-21swapper/321:25:373
14576242122,6sleep30-21swapper/321:15:323
14299952122,6sleep30-21swapper/320:45:403
14183612122,6sleep30-21swapper/320:35:323
14069162122,6sleep30-21swapper/320:25:283
13787802123,6sleep30-21swapper/319:55:313
13712592122,5sleep30-21swapper/319:50:013
13506232122,6sleep30-21swapper/319:25:383
13457142122,6sleep30-21swapper/319:20:403
16343192112,5sleep30-21swapper/300:15:243
15882232112,5sleep30-21swapper/323:25:403
15648472111,6sleep30-21swapper/323:05:243
15399672112,5sleep30-21swapper/322:40:253
15352372112,5sleep30-21swapper/322:35:273
15305732112,6sleep30-21swapper/322:30:293
15151952112,6sleep30-21swapper/322:15:203
15148822112,5sleep30-21swapper/322:14:203
15055322112,5sleep30-21swapper/322:05:263
14953952112,5sleep30-21swapper/321:55:183
14859312112,5sleep30-21swapper/321:45:263
14706252112,5sleep30-21swapper/321:30:013
14605342112,5sleep30-21swapper/321:20:033
14509562112,5sleep30-21swapper/321:10:283
14313172112,5sleep30-21swapper/320:50:293
14208162112,5sleep30-21swapper/320:40:013
13960452112,5sleep30-21swapper/320:15:023
13917662112,5sleep30-21swapper/320:10:283
13851122112,5sleep30-21swapper/320:00:333
13571572112,5sleep30-21swapper/319:35:283
13554712112,5sleep30-21swapper/319:30:343
15003392102,5sleep30-21swapper/322:00:113
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional