You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-29 - 04:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Sun Mar 29, 2026 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1446239995848,7cyclictest1750847-21latency_hist00:15:011
16353092540,5chrt0-21swapper/022:16:350
16353092540,5chrt0-21swapper/022:16:350
1446239995147,3cyclictest1671669-21kworker/u8:3+events_unbound23:00:381
1446236995041,7cyclictest280-21systemd-journal22:05:000
1446236994739,6cyclictest1726116-21latency_hist23:50:010
1446239994634,9cyclictest1675893-21ntpq22:56:381
1446236994640,4cyclictest280-21systemd-journal23:21:340
1446239994541,3cyclictest1507731-21kworker/u8:2+events_unbound21:20:371
1446239994530,11cyclictest280-21systemd-journal23:40:001
1446236994537,5cyclictest1497621-21latency_hist20:00:010
1446236994435,4cyclictest1472695-21kworker/u8:1+flush-8:020:11:380
15224272430,5sleep20-21swapper/220:25:012
1446239994334,6cyclictest280-21systemd-journal21:33:281
1446236994339,3cyclictest1492897-21kworker/u8:0+flush-8:021:51:290
1446236994338,3cyclictest1671669-21kworker/u8:3+flush-8:023:16:380
1446239994238,3cyclictest1507731-21kworker/u8:2+events_unbound21:29:011
1446239994228,11cyclictest280-21systemd-journal21:36:281
1446239994127,10cyclictest280-21systemd-journal23:25:001
1446236994135,4cyclictest1651758-21kworker/u8:1+flush-8:023:11:290
1446236994135,4cyclictest1507731-21kworker/u8:2+flush-8:020:41:320
1446236994131,8cyclictest1572207-21latency_hist21:15:010
1446239994036,3cyclictest549004-21kworker/u8:2+events_unbound19:53:421
1446236994035,3cyclictest1453305-21kworker/u8:4+events_unbound19:46:290
1446236994033,5cyclictest1560034-21kworker/u8:3+events_unbound21:21:400
1446239993935,3cyclictest1492897-21kworker/u8:0+events_unbound23:30:031
1446239993930,7cyclictest1527596-21/usr/sbin/munin20:31:431
1446236993929,7cyclictest1760564-21kworker/u8:1+events_unbound00:26:260
1446241993831,1cyclictest421rcuog/200:25:002
1446239993834,3cyclictest1671669-21kworker/u8:3+events_unbound00:15:371
1446236993835,2cyclictest1671669-21kworker/u8:3+flush-8:023:41:450
1446236993834,3cyclictest1671669-21kworker/u8:3+events_unbound23:31:390
1446236993833,3cyclictest1492897-21kworker/u8:0+flush-8:021:06:300
1446236993832,4cyclictest1507731-21kworker/u8:2+events_unbound20:40:010
14458932385,4sleep013-21ksoftirqd/019:07:550
17183552370,2sleep375-21kworker/3:1+mm_percpu_wq23:41:343
144624199372,11cyclictest16646762tr22:46:342
1446236993732,4cyclictest1507731-21kworker/u8:2+flush-8:021:01:460
1446236993731,4cyclictest1560034-21kworker/u8:3+flush-8:022:11:380
1446241993629,5cyclictest1671632-21cp22:55:012
1446241993617,3cyclictest161rcu_preempt23:40:012
1446239993632,3cyclictest1431679-21kworker/u8:0+flush-8:019:20:001
1446239993626,8cyclictest1641009-21ntpq22:21:381
1446239993626,8cyclictest1641009-21ntpq22:21:381
1446236993631,4cyclictest1651758-21kworker/u8:1+flush-8:023:06:440
1446236993631,3cyclictest1671669-21kworker/u8:3+flush-8:000:06:340
1446236993631,3cyclictest1507731-21kworker/u8:2+flush-8:022:26:420
1446236993630,4cyclictest1492897-21kworker/u8:0+events_unbound20:01:280
144624199358,8cyclictest1631728-21cron22:15:002
1446239993531,2cyclictest1772065-21irqrtprio00:36:321
1446239993524,5cyclictest0-21swapper/100:21:261
1446239993523,9cyclictest280-21systemd-journal22:01:291
1446236993529,4cyclictest1651758-21kworker/u8:1+events_unbound22:46:320
1446236993525,8cyclictest1472877-21latency_hist19:35:000
1446236993525,3cyclictest1507731-21kworker/u8:2+events_unbound20:46:320
14415302354,10sleep10-21swapper/119:06:111
1446239993430,2cyclictest1669201-21kthreadcore22:51:351
1446236993430,3cyclictest1671669-21kworker/u8:3+flush-8:023:56:320
1446236993429,4cyclictest1492897-21kworker/u8:0+flush-8:000:01:310
1446236993429,3cyclictest1560034-21kworker/u8:3+flush-8:022:31:450
1446236993429,3cyclictest1507731-21kworker/u8:2+flush-8:021:41:330
1446236993428,4cyclictest1492897-21kworker/u8:0+events_unbound22:51:450
1446236993425,3cyclictest1472695-21kworker/u8:1+events_unbound20:31:410
1446239993328,3cyclictest1656702-21cron22:40:001
1446236993328,3cyclictest1671669-21kworker/u8:3+events_unbound23:40:010
1446239993223,6cyclictest1497262-21grep19:56:461
1446239993212,4cyclictest1696636-21ls23:20:011
1446236993228,3cyclictest1560034-21kworker/u8:3+flush-8:021:16:340
1446236993227,4cyclictest1472695-21kworker/u8:1+flush-8:020:21:340
1446236993227,3cyclictest1492897-21kworker/u8:0+events_unbound20:56:440
1446239993127,2cyclictest1487720-21systemd-run19:50:011
1446239993127,2cyclictest1458992-21irqcore19:21:331
1446239993126,3cyclictest1569797-21kthreadcore21:11:341
1446239993126,3cyclictest1451123-21latency_hist19:15:011
1446239993123,5cyclictest1616901-21latency_hist22:00:011
1446236993127,3cyclictest1492897-21kworker/u8:0+events_unbound22:41:410
1446236993126,4cyclictest1671669-21kworker/u8:3+flush-8:023:52:200
1446236993126,4cyclictest1671669-21kworker/u8:3+events_unbound23:01:320
1446236993126,4cyclictest1446095-21kworker/u8:3+flush-8:019:15:050
1446236993126,3cyclictest1750836-21cron00:15:000
1446236993118,4cyclictest1671669-21kworker/u8:3+events_unbound00:31:310
144624199309,11cyclictest0-21swapper/219:21:332
1446241993025,4cyclictest1446727-21cpuspeed_turbos19:11:272
1446241993024,4cyclictest1606734-21unixbench_singl21:46:452
1446239993019,2cyclictest161rcu_preempt19:31:121
1446239993015,11cyclictest280-21systemd-journal21:01:281
1446236993024,4cyclictest1502923-21/usr/sbin/munin20:06:440
1446236993024,4cyclictest1453305-21kworker/u8:4+flush-8:019:51:400
1446241992925,2cyclictest1701078-21unixbench_singl23:21:452
1446241992925,2cyclictest1591884-21unixbench_singl21:31:442
1446241992910,10cyclictest0-21swapper/223:11:352
1446241992910,10cyclictest0-21swapper/222:36:382
1446239992924,3cyclictest1736018-21munin-run00:00:001
1446239992924,3cyclictest1533165-21cut20:36:291
1446239992924,3cyclictest1512479-21systemd-run20:15:011
1446236992925,3cyclictest1453305-21kworker/u8:4+events_unbound19:41:510
1446236992925,3cyclictest1431679-21kworker/u8:0+flush-8:019:21:430
1446236992924,4cyclictest1761261-21apt-key00:25:010
1446236992924,4cyclictest1507731-21kworker/u8:2+flush-8:022:36:320
1446236992924,4cyclictest1507731-21kworker/u8:2+events_unbound20:26:280
1446236992923,4cyclictest1507731-21kworker/u8:2+events_unbound21:26:370
144624199288,4cyclictest0-21swapper/220:36:252
1446241992825,2cyclictest1498308-21fschecks_time20:01:312
1446241992824,2cyclictest1771431-21aten2_r5power_p00:36:272
1446241992810,10cyclictest0-21swapper/222:31:452
144623999285,15cyclictest1646976-21date22:30:001
1446239992824,3cyclictest1651758-21kworker/u8:1+events_unbound00:03:341
1446239992824,3cyclictest1492897-21kworker/u8:0+events_unbound00:08:121
1446239992823,3cyclictest1637101-21seq22:20:001
1446239992823,3cyclictest1637101-21seq22:20:001
1446239992823,3cyclictest1602715-21cut21:46:291
1446239992822,4cyclictest1566985-21unixbench_singl21:06:471
1446239992822,4cyclictest1472695-21kworker/u8:1-ext4-rsv-conversion20:50:001
1446239992817,2cyclictest161rcu_preempt22:45:541
1446239992817,2cyclictest161rcu_preempt19:44:451
1446239992814,3cyclictest0-21swapper/120:51:351
1446239992813,3cyclictest0-21swapper/100:26:461
1446239992813,2cyclictest0-21swapper/123:11:341
1446236992824,3cyclictest1446095-21kworker/u8:3+events_unbound19:11:430
1446236992823,3cyclictest1507731-21kworker/u8:2+events_unbound22:21:370
1446236992823,3cyclictest1507731-21kworker/u8:2+events_unbound22:21:370
1446236992821,5cyclictest1492897-21kworker/u8:0+flush-8:020:51:400
14741162270,4sleep10-21swapper/119:36:321
14741162270,4sleep10-21swapper/119:36:321
144624199278,7cyclictest0-21swapper/221:01:292
144624199278,10cyclictest0-21swapper/221:36:342
1446241992723,2cyclictest1641497-21unixbench_multi22:21:462
1446241992723,2cyclictest1641497-21unixbench_multi22:21:462
1446241992723,2cyclictest1503036-21aten2_r5power_p20:06:282
1446241992722,3cyclictest1453628-21cpuspeed_turbos19:16:272
1446241992710,4cyclictest0-21swapper/200:26:362
144623999279,5cyclictest1721459-21seq23:45:441
144623999277,9cyclictest0-21swapper/120:56:301
144623999276,14cyclictest30-21ksoftirqd/120:01:431
1446239992722,3cyclictest1467661-21unixbench_singl19:26:451
1446239992720,4cyclictest0-21swapper/120:16:461
1446239992717,6cyclictest161rcu_preempt00:34:591
1446239992717,2cyclictest161rcu_preempt20:09:451
1446239992716,8cyclictest280-21systemd-journal22:11:281
1446239992716,2cyclictest161rcu_preempt20:23:171
1446236992723,3cyclictest1624387-21kthreadcore22:06:340
1446236992723,3cyclictest1624387-21kthreadcore22:06:340
1446236992723,3cyclictest1492897-21kworker/u8:0+events_unbound21:39:290
1446236992722,4cyclictest549004-21kworker/u8:2+events_unbound19:26:390
144624199267,5cyclictest0-21swapper/220:16:342
144624199264,4cyclictest0-21swapper/219:51:322
1446241992614,4cyclictest161rcu_preempt22:01:372
1446241992613,1cyclictest161rcu_preempt20:26:432
1446241992612,12cyclictest1567886-21sshd21:11:282
1446241992610,8cyclictest0-21swapper/221:16:302
144624199260,15cyclictest1751966-21ps00:16:332
144624199260,14cyclictest1612316-21apt-get21:56:262
144623999268,11cyclictest30-21ksoftirqd/121:20:011
144623999266,6cyclictest1625871-21sed22:06:361
144623999266,6cyclictest1625871-21sed22:06:361
144623999265,6cyclictest30-21ksoftirqd/123:41:341
144623999265,11cyclictest30-21ksoftirqd/121:41:331
1446239992622,3cyclictest1671669-21kworker/u8:3+events_unbound23:53:131
1446239992618,3cyclictest161rcu_preempt22:31:371
1446239992615,2cyclictest161rcu_preempt20:25:141
1446239992613,4cyclictest589-21runrttasks23:26:551
1446236992622,3cyclictest1477872-21systemd-run19:40:000
1446236992622,3cyclictest1477872-21systemd-run19:40:000
1446236992621,3cyclictest1507731-21kworker/u8:2+flush-8:021:46:390
1446236992620,4cyclictest1751152-21apt-get00:15:520
1446241992513,2cyclictest161rcu_preempt20:41:352
144624199250,10cyclictest1675836-21taskset22:56:362
144623999256,9cyclictest0-21swapper/122:41:401
1446239992519,3cyclictest0-21swapper/121:51:311
1446236992521,3cyclictest1492897-21kworker/u8:0+events_unbound23:30:010
1446236992520,3cyclictest1774968-21/usr/sbin/munin00:36:360
144624199249,4cyclictest0-21swapper/222:16:302
144624199249,4cyclictest0-21swapper/222:16:302
144624199249,10cyclictest0-21swapper/222:26:292
144624199248,3cyclictest1468675-21fschecks_time19:31:302
144624199246,10cyclictest0-21swapper/219:56:342
144624199245,4cyclictest1724165-21cut23:46:342
144624199245,3cyclictest161rcu_preempt22:06:362
144624199245,3cyclictest161rcu_preempt22:06:362
144624199244,5cyclictest1684604-21kthreadcore23:06:352
144624199240,9cyclictest1711000-21awk23:31:462
144624199240,7cyclictest1479625-21cut19:41:332
144623999245,6cyclictest30-21ksoftirqd/120:41:401
1446236992420,3cyclictest1517066-21unixbench_singl20:16:470
1446236992420,2cyclictest1676747-21idleruntime-cro23:00:000
1446236992418,4cyclictest1507731-21kworker/u8:2+flush-8:021:56:390
1446236992418,4cyclictest1507731-21kworker/u8:2+events_unbound21:31:420
144624199238,2cyclictest161rcu_preempt00:00:002
144624199236,3cyclictest1598843-21cut21:41:332
144624199236,2cyclictest0-21swapper/221:10:012
144624199233,5cyclictest0-21swapper/223:51:462
144624199232,4cyclictest0-21swapper/219:36:432
144624199232,4cyclictest0-21swapper/219:36:432
1446241992320,2cyclictest1741448-21aten2_r5power_v00:06:282
1446241992319,3cyclictest1607622-21cpuspeed_turbos21:51:272
1446241992317,4cyclictest1696097-21unixbench_multi23:16:442
144624199230,5cyclictest1750005-21ntpq00:11:382
144624199230,12cyclictest1661836-21latency_hist22:45:012
144623999237,4cyclictest0-21swapper/123:06:271
144624199228,5cyclictest0-21swapper/220:11:302
144624199223,5cyclictest0-21swapper/221:26:282
144624199223,10cyclictest0-21swapper/223:26:362
1446241992218,2cyclictest1542742-21aten2_r5power_e20:46:282
1446241992218,2cyclictest0-21swapper/223:01:462
144624199216,2cyclictest161rcu_preempt00:01:442
144624199213,4cyclictest0-21swapper/220:31:452
144624199212,5cyclictest0-21swapper/200:31:272
1446241992118,2cyclictest371rcuc/223:41:222
144624199210,19cyclictest381ktimers/221:21:362
144624199210,11cyclictest1483865-21ps19:46:322
144624199203,2cyclictest161rcu_preempt20:56:262
144624199202,7cyclictest0-21swapper/219:26:342
144624199192,3cyclictest0-21swapper/220:51:272
14459762193,9sleep30-21swapper/319:08:583
14459472194,9sleep20-21swapper/219:08:372
16366642156,5sleep30-21swapper/322:20:003
16366642156,5sleep30-21swapper/322:20:003
17567322142,8sleep30-21swapper/300:21:323
15117462140,4sleep3481ktimers/320:11:423
17014202132,6sleep30-21swapper/323:25:023
16807252133,6sleep30-21swapper/323:01:383
16280472133,6sleep30-21swapper/322:11:343
16227022132,7sleep30-21swapper/322:06:323
16227022132,7sleep30-21swapper/322:06:323
15673362132,6sleep30-21swapper/321:10:023
15525392132,7sleep30-21swapper/320:56:253
14788142132,7sleep30-21swapper/319:41:333
14778162133,6sleep30-21swapper/319:40:003
14778162133,6sleep30-21swapper/319:40:003
17658922122,6sleep30-21swapper/300:28:063
17555562122,6sleep30-21swapper/300:16:463
17457102122,6sleep30-21swapper/300:07:353
17360342122,5sleep30-21swapper/300:00:003
17350262122,6sleep30-21swapper/323:56:363
17262372122,6sleep30-21swapper/323:50:023
17257462122,6sleep30-21swapper/323:46:453
17161762122,6sleep30-21swapper/323:39:343
16918842123,5sleep30-21swapper/323:16:273
16824772122,6sleep30-21swapper/323:06:323
16757162122,6sleep30-21swapper/322:56:363
16472272122,6sleep30-21swapper/322:31:283
16377812122,6sleep30-21swapper/322:21:333
16377812122,6sleep30-21swapper/322:21:333
16097962122,6sleep30-21swapper/321:51:353
16021112122,5sleep30-21swapper/321:45:013
16015102122,6sleep30-21swapper/321:41:443
15924102122,6sleep30-21swapper/321:35:023
15732042122,6sleep30-21swapper/321:16:323
15626462122,6sleep30-21swapper/321:06:243
15480002122,6sleep30-21swapper/320:51:323
15423502122,5sleep30-21swapper/320:45:013
15376452122,6sleep30-21swapper/320:40:283
15227842124,5sleep30-21swapper/320:26:273
15173852122,5sleep30-21swapper/320:20:013
15171252122,6sleep30-21swapper/320:17:003
14688422122,6sleep30-21swapper/319:31:333
14582542122,6sleep30-21swapper/319:20:023
17719292112,5sleep30-21swapper/300:36:333
17702762112,5sleep30-21swapper/300:31:433
17106522112,5sleep30-21swapper/323:31:443
16968102112,5sleep30-21swapper/323:21:243
16914032112,5sleep30-21swapper/323:13:383
16667782112,5sleep30-21swapper/322:50:023
16658572112,5sleep30-21swapper/322:46:413
16610792112,5sleep30-21swapper/322:41:443
16520112112,5sleep30-21swapper/322:35:463
16426672112,5sleep30-21swapper/322:26:313
16163922112,5sleep30-21swapper/321:56:453
15878922112,5sleep30-21swapper/321:31:293
15830612112,5sleep30-21swapper/321:26:313
15782442111,6sleep30-21swapper/321:21:333
15576042112,5sleep30-21swapper/321:00:023
15326812112,5sleep30-21swapper/320:35:023
15284692112,5sleep30-21swapper/320:31:333
15067052112,5sleep30-21swapper/320:06:413
14982402111,6sleep30-21swapper/320:01:313
14970562112,6sleep30-21swapper/319:56:463
14879512112,5sleep30-21swapper/319:50:283
14830902112,5sleep30-21swapper/319:46:063
14673772112,5sleep30-21swapper/319:26:443
14574872112,5sleep30-21swapper/319:16:453
14463592112,5sleep30-21swapper/319:10:023
17461382102,5sleep30-21swapper/300:10:043
16171352102,5sleep30-21swapper/322:00:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional