You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-24 - 14:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Sun May 24, 2026 12:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
48083422640,1sleep375-21kworker/3:1-events08:35:503
52241922190,2sleep375-21kworker/3:1-events09:20:013
5256852600,5chrt451irq_work/309:20:533
391374995546,6cyclictest1704890-21systemd-journal10:50:470
391374995449,3cyclictest700999-21kworker/u8:2+flush-8:012:26:010
391374995348,3cyclictest622433-21kworker/u8:0+flush-8:011:56:030
391378995247,4cyclictest398412-21kworker/u8:0+flush-8:007:20:001
391378995246,4cyclictest3736422-21kworker/u8:1+flush-8:008:05:491
391374995247,3cyclictest381339-21kworker/u8:3+events_unbound07:31:000
391374995245,5cyclictest1704890-21systemd-journal11:05:470
391374995043,5cyclictest681175-21kworker/u8:3+flush-8:012:10:560
391374995040,8cyclictest463098-21diskstats08:20:480
391378994943,5cyclictest497821-21kworker/u8:3+flush-8:009:31:001
391374994945,3cyclictest531347-21kworker/u8:4+flush-8:010:55:560
391374994944,4cyclictest3736422-21kworker/u8:1+flush-8:007:51:010
391374994943,5cyclictest602247-21kworker/u8:0+flush-8:010:45:550
391374994843,4cyclictest622433-21kworker/u8:0+events_unbound12:20:560
391374994842,5cyclictest457578-21kworker/u8:3+flush-8:008:30:570
391374994842,5cyclictest457578-21kworker/u8:3+flush-8:008:30:560
391374994842,4cyclictest381339-21kworker/u8:3+flush-8:007:20:470
391374994842,4cyclictest381339-21kworker/u8:3+flush-8:007:20:470
391374994841,6cyclictest497821-21kworker/u8:3+flush-8:010:05:560
391374994743,3cyclictest522543-21kworker/u8:0+flush-8:009:21:010
391374994742,3cyclictest447718-21kworker/u8:0+flush-8:008:45:580
391374994741,5cyclictest531347-21kworker/u8:4+events_unbound09:40:450
391374994741,5cyclictest531347-21kworker/u8:4+events_unbound09:40:440
391374994739,6cyclictest541290-21ntpq09:35:550
391374994636,8cyclictest660813-21ntpq11:35:560
391378994539,4cyclictest457578-21kworker/u8:3+flush-8:008:15:591
391378994538,5cyclictest597055-21/usr/sbin/munin10:35:551
391374994541,3cyclictest615961-21kworker/u8:1+flush-8:011:01:010
391374994541,3cyclictest615961-21kworker/u8:1+flush-8:011:01:010
391374994540,3cyclictest531347-21kworker/u8:4+flush-8:010:35:570
391374994539,5cyclictest531347-21kworker/u8:4+flush-8:009:45:580
391378994438,4cyclictest457578-21kworker/u8:3+flush-8:008:25:481
391378994438,4cyclictest381339-21kworker/u8:3+flush-8:007:45:471
391374994439,4cyclictest457578-21kworker/u8:3+events_unbound08:15:560
391374994439,3cyclictest531347-21kworker/u8:4+flush-8:010:01:040
391374994432,9cyclictest486625-21ntpq08:40:560
391380994335,5cyclictest492737-21cat08:50:012
391378994336,5cyclictest531347-21kworker/u8:4+flush-8:011:26:011
391374994337,5cyclictest477544-21kworker/u8:2+flush-8:009:15:550
391374994337,5cyclictest477544-21kworker/u8:2+flush-8:008:36:030
391374994332,8cyclictest431964-21ntpq07:45:550
391378994237,4cyclictest477544-21kworker/u8:2+flush-8:009:15:591
391378994237,4cyclictest3736422-21kworker/u8:1+flush-8:008:00:481
391378994237,4cyclictest3736422-21kworker/u8:1+events_unbound08:10:581
391378994234,6cyclictest425909-21kworker/u8:2+flush-8:007:41:021
391374994237,4cyclictest447718-21kworker/u8:0+flush-8:008:25:560
391374994235,5cyclictest615961-21kworker/u8:1+flush-8:012:00:580
391374994231,9cyclictest690574-21ntpq12:05:590
391378994135,4cyclictest562469-21apt-get10:00:431
391374994137,3cyclictest3736422-21kworker/u8:1+flush-8:008:11:020
391374994136,3cyclictest522543-21kworker/u8:0+events_unbound10:10:500
391374994136,3cyclictest497821-21kworker/u8:3+flush-8:009:05:540
391374994135,4cyclictest497821-21kworker/u8:3+events_unbound10:30:560
391374994135,4cyclictest3736422-21kworker/u8:1+flush-8:008:05:590
391374994134,5cyclictest412159-21ntpq07:25:550
391378994034,4cyclictest477544-21kworker/u8:2+flush-8:009:05:491
391378994033,4cyclictest617213-21apt-key10:55:011
391374994035,4cyclictest531347-21kworker/u8:4+flush-8:010:40:480
391374994035,3cyclictest585973-21ntpq10:20:540
391374994034,4cyclictest522543-21kworker/u8:0+flush-8:009:26:010
391374994034,4cyclictest447718-21kworker/u8:0+flush-8:008:50:580
391374994027,9cyclictest1704890-21systemd-journal08:00:470
391380993928,8cyclictest1704890-21systemd-journal12:10:462
391380993926,11cyclictest642527-21fschecks_count11:20:472
391378993933,4cyclictest413333-21apt-get07:30:431
391378993931,6cyclictest477544-21kworker/u8:2+flush-8:008:35:561
391374993935,3cyclictest622433-21kworker/u8:0+flush-8:011:51:010
391374993934,3cyclictest497821-21kworker/u8:3+flush-8:010:15:490
391374993933,4cyclictest531347-21kworker/u8:4+flush-8:009:56:360
391374993932,5cyclictest615961-21kworker/u8:1+flush-8:011:45:550
391374993932,5cyclictest522543-21kworker/u8:0+flush-8:010:25:590
391380993822,14cyclictest578221-21kthreadcore10:15:502
391374993834,3cyclictest497821-21kworker/u8:3+flush-8:009:11:010
391374993834,3cyclictest497821-21kworker/u8:3+events_unbound09:51:020
391374993832,4cyclictest531347-21kworker/u8:4+events_unbound11:25:460
39138099372,15cyclictest597082-21apt-get10:35:422
391378993732,4cyclictest457578-21kworker/u8:3+flush-8:008:30:491
391378993732,4cyclictest457578-21kworker/u8:3+flush-8:008:30:491
391378993731,4cyclictest615961-21kworker/u8:1+events_unbound11:05:541
391378993730,5cyclictest492427-21apt-get08:50:001
391374993733,3cyclictest381339-21kworker/u8:3+flush-8:007:55:540
391374993732,3cyclictest531347-21kworker/u8:4+flush-8:011:30:520
391374993727,7cyclictest1704890-21systemd-journal11:20:000
39138099363,13cyclictest612302-21apt-get10:50:442
391378993631,3cyclictest615961-21kworker/u8:1+flush-8:011:35:561
391374993630,5cyclictest381339-21kworker/u8:3+flush-8:007:10:570
391374993630,4cyclictest615961-21kworker/u8:1+flush-8:011:10:570
391374993626,8cyclictest506626-21ntpq09:00:580
391380993523,10cyclictest552927-21fschecks_time09:50:472
391380993522,11cyclictest522937-21fschecks_time09:20:462
391380993520,14cyclictest622433-21kworker/u8:0-ext4-rsv-conversion11:05:002
391380993520,14cyclictest622433-21kworker/u8:0-ext4-rsv-conversion11:05:002
391378993525,8cyclictest552034-21apt-get09:49:591
391374993530,4cyclictest711495-21kworker/u8:1+flush-8:012:35:470
391380993418,14cyclictest1704890-21systemd-journal11:53:482
391378993429,4cyclictest497821-21kworker/u8:3+flush-8:009:25:481
391378993424,8cyclictest1704890-21systemd-journal09:11:481
39138099333,7cyclictest701631-21apt-get12:20:432
391380993315,16cyclictest0-21swapper/209:00:012
391380993315,16cyclictest0-21swapper/207:10:552
391378993328,4cyclictest497821-21kworker/u8:3+flush-8:010:15:571
391378993328,3cyclictest497821-21kworker/u8:3+flush-8:010:31:001
391374993327,4cyclictest381339-21kworker/u8:3+flush-8:007:16:040
391374993326,5cyclictest531347-21kworker/u8:4+flush-8:011:40:520
391374993326,5cyclictest381339-21kworker/u8:3+events_unbound07:35:550
39138099322,10cyclictest472436-21apt-get08:30:032
39138099322,10cyclictest472436-21apt-get08:30:022
391378993228,3cyclictest398412-21kworker/u8:0+flush-8:007:25:481
391378993228,3cyclictest381339-21kworker/u8:3+flush-8:007:36:011
391378993226,5cyclictest457578-21kworker/u8:3+events_unbound08:20:471
391378993225,5cyclictest615961-21kworker/u8:1+flush-8:012:06:011
391378993222,7cyclictest1704890-21systemd-journal10:05:471
391374993225,5cyclictest1704890-21systemd-journal11:20:550
391374993222,7cyclictest1704890-21systemd-journal07:40:470
391380993118,11cyclictest0-21swapper/212:20:002
391380993118,11cyclictest0-21swapper/212:20:002
391380993116,13cyclictest413553-21cpuspeed_turbos07:30:452
391380993113,2cyclictest0-21swapper/212:05:002
391378993127,3cyclictest615961-21kworker/u8:1+flush-8:012:01:021
391378993127,3cyclictest615961-21kworker/u8:1+flush-8:011:46:001
391378993127,3cyclictest602247-21kworker/u8:0+flush-8:010:45:481
391378993127,3cyclictest381339-21kworker/u8:3+flush-8:007:10:481
391378993127,3cyclictest381339-21kworker/u8:3+events_unbound07:21:001
391378993127,3cyclictest381339-21kworker/u8:3+events_unbound07:21:001
391378993127,2cyclictest676563-21cron11:54:591
391378993126,4cyclictest3736422-21kworker/u8:1+flush-8:007:56:021
391378993126,3cyclictest582250-21apt-get10:20:421
391374993128,2cyclictest622433-21kworker/u8:0+flush-8:012:15:260
391374993128,2cyclictest622433-21kworker/u8:0+flush-8:012:15:250
391374993127,3cyclictest477544-21kworker/u8:2+events_unbound08:55:470
39138099307,7cyclictest585766-21tr10:20:522
39138099303,5cyclictest711532-21apt-get12:30:462
391378993027,2cyclictest615961-21kworker/u8:1+events_unbound11:11:031
391378993025,4cyclictest531347-21kworker/u8:4+flush-8:009:50:451
391378993025,4cyclictest531347-21kworker/u8:4+events_unbound11:30:551
391378993024,4cyclictest1704890-21systemd-journal12:15:001
39138099292,7cyclictest422097-21ntpq07:35:572
391380992926,2cyclictest512807-21aten2_r5power_e09:10:452
391380992914,13cyclictest628364-21uname11:05:522
391380992914,13cyclictest472027-21unixbench_multi08:26:032
391380992912,2cyclictest0-21swapper/208:41:022
391380992911,2cyclictest0-21swapper/211:15:012
391380992911,16cyclictest0-21swapper/208:11:042
39138099291,10cyclictest463010-21cpuspeed08:20:452
391380992910,5cyclictest1-21systemd09:10:002
391380992910,3cyclictest0-21swapper/212:00:002
391380992910,3cyclictest0-21swapper/210:00:542
391378992924,4cyclictest477544-21kworker/u8:2+flush-8:008:50:481
391378992923,4cyclictest641975-21systemd-run11:20:011
391378992923,4cyclictest602247-21kworker/u8:0+events_unbound10:41:011
39138099286,7cyclictest436190-21tr07:50:532
39138099283,7cyclictest662019-21apt-get11:40:422
391380992824,2cyclictest521923-21unixbench_singl09:16:032
39138099281,9cyclictest655881-21ntpq11:30:562
391380992811,2cyclictest0-21swapper/208:51:002
391380992811,2cyclictest0-21swapper/207:20:002
391378992824,3cyclictest531347-21kworker/u8:4+events_unbound11:40:451
391378992824,2cyclictest617250-21latency_hist10:55:001
391378992823,3cyclictest702355-21irqrtprio12:20:491
391378992817,8cyclictest1704890-21systemd-journal09:25:001
391374992822,4cyclictest715325-21ntpq12:30:580
39138099279,3cyclictest711224-21idleruntime-cro12:30:012
39138099279,2cyclictest0-21swapper/207:21:012
39138099279,2cyclictest0-21swapper/207:21:002
39138099278,7cyclictest541651-21sed09:36:012
39138099277,7cyclictest592583-21awk10:30:482
39138099273,7cyclictest423254-21apt-get07:40:442
39138099273,6cyclictest408420-21apt-get07:25:442
39138099272,10cyclictest441904-21ntpq07:55:592
391380992712,13cyclictest689824-21kthreadcore12:05:562
391380992712,13cyclictest0-21swapper/211:25:532
391378992723,3cyclictest700999-21kworker/u8:2+events_unbound12:25:471
391378992723,3cyclictest671607-21kworker/u8:2+events_unbound11:55:591
391378992723,3cyclictest587910-21irqrtprio10:25:501
391378992722,3cyclictest477544-21kworker/u8:2+events_unbound08:41:031
391378992721,4cyclictest696675-21apt-get12:15:421
391378992721,4cyclictest696675-21apt-get12:15:421
391378992717,8cyclictest716459-21/usr/sbin/munin12:35:561
391374992725,1cyclictest497821-21kworker/u8:3+events_unbound09:34:370
39138099267,6cyclictest551447-21sed09:46:002
39138099267,6cyclictest546524-21grep09:41:022
39138099267,6cyclictest546524-21grep09:41:022
39138099267,6cyclictest447180-21grep08:01:032
39138099265,3cyclictest521rcuop/312:35:542
39138099262,9cyclictest571121-21ntpq10:05:532
39138099262,6cyclictest506641-21ntpq09:00:582
39138099262,6cyclictest428212-21apt-get07:45:442
39138099261,8cyclictest611157-21ntpq10:45:572
39138099261,10cyclictest576106-21ntpq10:10:552
391380992610,2cyclictest557592-21aten2_r5power_e09:55:442
391378992622,3cyclictest546779-21unixbench_singl09:41:031
391378992622,3cyclictest546779-21unixbench_singl09:41:031
391378992618,5cyclictest627157-21latency_hist11:05:011
391378992618,5cyclictest627157-21latency_hist11:05:001
3910462263,17sleep00-21swapper/007:08:170
39138099257,7cyclictest637596-21cut11:15:472
39138099252,8cyclictest660883-21ntpq11:35:572
39138099251,9cyclictest602569-21diskstats10:40:472
391380992515,7cyclictest1704890-21systemd-journal08:40:002
391380992511,2cyclictest0-21swapper/208:16:032
391378992520,3cyclictest0-21swapper/109:35:491
39138099241,10cyclictest667703-21ps11:45:492
391378992420,3cyclictest503597-21irqrtprio09:00:501
391378992420,2cyclictest0-21swapper/108:55:551
391378992419,4cyclictest20977-21cron11:25:011
391378992419,3cyclictest561786-21unixbench_singl09:56:021
391378992418,5cyclictest522543-21kworker/u8:0+events_unbound10:10:441
391378992417,6cyclictest3736422-21kworker/u8:1+events_unbound07:50:441
39138099239,2cyclictest0-21swapper/210:56:022
39138099232,6cyclictest527578-21apt-get09:25:452
3865752224,12sleep10-21swapper/107:05:091
39138099215,6cyclictest588961-21cut10:25:522
39138099204,7cyclictest533387-21sed09:30:512
391378992016,2cyclictest0-21swapper/112:31:021
3911672206,10sleep20-21swapper/207:09:512
4208742190,3chrt75-21kworker/3:1+events07:35:523
6959542180,2sleep3481ktimers/312:11:033
391380991810,6cyclictest450244-21tr08:05:532
3910092183,9sleep30-21swapper/307:07:483
6188112178,6sleep30-21swapper/310:55:513
7117852144,6sleep30-21swapper/312:30:503
7016052132,7sleep30-21swapper/312:20:433
6617452132,6sleep30-21swapper/311:40:013
6111262132,7sleep30-21swapper/310:45:573
5711572133,6sleep30-21swapper/310:05:553
5623432132,6sleep30-21swapper/310:00:023
4767062132,7sleep30-21swapper/308:30:593
4767062132,7sleep30-21swapper/308:30:593
4602502132,7sleep30-21swapper/308:15:543
4089112132,7sleep30-21swapper/307:25:503
7068572122,6sleep30-21swapper/312:25:473
7000082122,6sleep30-21swapper/312:15:573
7000082122,6sleep30-21swapper/312:15:573
6869662122,6sleep30-21swapper/312:05:463
6804632123,6sleep30-21swapper/311:55:543
6718962122,6sleep30-21swapper/311:50:453
6715762122,5sleep30-21swapper/311:50:013
6609402122,6sleep30-21swapper/311:36:013
6561502122,6sleep30-21swapper/311:31:033
6466552122,6sleep30-21swapper/311:21:483
6370482122,6sleep30-21swapper/311:15:023
6274622122,6sleep30-21swapper/311:05:463
6221962122,5sleep30-21swapper/311:00:013
6221962122,5sleep30-21swapper/311:00:013
6162272122,6sleep30-21swapper/310:51:023
5968032122,5sleep30-21swapper/310:35:013
5871612122,6sleep30-21swapper/310:25:433
5787372121,6sleep30-21swapper/310:15:513
5720462122,5sleep30-21swapper/310:10:023
5541482122,6sleep30-21swapper/309:50:513
5475192122,6sleep30-21swapper/309:45:463
5345372122,6sleep30-21swapper/309:30:533
5172482122,6sleep30-21swapper/309:13:483
5080442122,6sleep30-21swapper/309:05:483
5028472123,5sleep30-21swapper/309:00:443
4976182122,6sleep30-21swapper/308:55:023
4923202122,6sleep30-21swapper/308:48:483
4674842122,6sleep30-21swapper/308:25:013
4571362122,6sleep30-21swapper/308:11:043
4517782122,6sleep30-21swapper/308:05:583
4364222122,6sleep30-21swapper/307:50:533
4285242123,6sleep30-21swapper/307:45:483
4231752122,5sleep30-21swapper/307:40:033
4038862122,6sleep30-21swapper/307:20:493
4038862122,6sleep30-21swapper/307:20:493
4023632122,6sleep30-21swapper/307:16:073
3915662122,5sleep30-21swapper/307:10:453
7208522112,5sleep30-21swapper/312:36:033
6817742112,6sleep30-21swapper/312:00:243
6476232112,5sleep30-21swapper/311:25:483
6326422112,6sleep30-21swapper/311:10:493
6022902112,5sleep30-21swapper/310:40:423
5921482112,6sleep30-21swapper/310:30:443
5823112112,5sleep30-21swapper/310:20:453
5575392112,5sleep30-21swapper/309:55:453
5428002112,6sleep30-21swapper/309:40:483
5428002112,6sleep30-21swapper/309:40:473
5374172112,5sleep30-21swapper/309:35:033
5275522112,5sleep30-21swapper/309:25:443
4928852112,5sleep30-21swapper/308:50:043
4826082112,5sleep30-21swapper/308:40:013
4715412112,5sleep30-21swapper/308:25:573
4469152112,5sleep30-21swapper/308:01:013
4386012112,5sleep30-21swapper/307:55:523
4135842112,5sleep30-21swapper/307:30:483
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional