You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-15 - 08:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Fri May 15, 2026 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
73245997566,6cyclictest298314-21kworker/u8:1+events_unbound23:26:061
73241996834,25cyclictest323839-21latency_hist23:20:010
73245996557,6cyclictest84093-21ntpq19:16:031
73247996458,4cyclictest324084-21kworker/u8:0+flush-8:023:41:092
73245996456,6cyclictest189930-21kworker/u8:3+flush-8:022:01:081
73241996452,8cyclictest268741-21latency_hist22:25:010
73241996440,21cyclictest353491-21latency_hist23:50:010
73241996440,21cyclictest353491-21latency_hist23:50:010
73245996358,3cyclictest194532-21kworker/u8:4+events_unbound22:36:091
73245996257,3cyclictest324084-21kworker/u8:0+events_unbound23:35:541
73245996151,7cyclictest3440679-21kworker/u8:3+flush-8:020:06:041
73245996055,3cyclictest78300-21kworker/u8:1+flush-8:019:40:001
73245996053,5cyclictest78300-21kworker/u8:1+flush-8:019:51:051
73245996051,7cyclictest3440679-21kworker/u8:3+flush-8:020:16:081
73245995951,6cyclictest193611-21apt-get21:06:091
73245995853,4cyclictest67982-21kworker/u8:2+events_unbound20:25:521
73245995852,4cyclictest3440679-21kworker/u8:3+events_unbound19:11:071
73245995852,4cyclictest189930-21kworker/u8:3+events_unbound22:00:011
73245995849,7cyclictest324084-21kworker/u8:0+flush-8:023:56:051
73245995751,4cyclictest67982-21kworker/u8:2+flush-8:020:46:041
73245995749,7cyclictest78300-21kworker/u8:1+flush-8:020:01:081
73241995751,5cyclictest194532-21kworker/u8:4+flush-8:022:11:050
73245995651,4cyclictest189930-21kworker/u8:3+events_unbound23:20:011
73245995550,4cyclictest3440679-21kworker/u8:3+events_unbound20:10:571
73241995548,5cyclictest338868-21kworker/u8:2+flush-8:023:51:060
73245995450,3cyclictest189930-21kworker/u8:3+events_unbound21:26:081
73245995449,3cyclictest3440679-21kworker/u8:3+events_unbound19:26:081
73245995448,4cyclictest67982-21kworker/u8:2+flush-8:019:31:041
73245995448,4cyclictest3440679-21kworker/u8:3+flush-8:019:41:031
73245995447,5cyclictest3440679-21kworker/u8:3+flush-8:019:56:071
73245995345,6cyclictest268836-21cp22:25:011
73241995348,3cyclictest67982-21kworker/u8:2+events_unbound19:26:100
73245995246,4cyclictest67982-21kworker/u8:2+events_unbound20:21:091
73241995230,19cyclictest153835-21ntpq20:26:010
73245995145,4cyclictest189930-21kworker/u8:3+events_unbound21:21:071
73245995145,4cyclictest147066-21kworker/u8:0+flush-8:022:50:011
73245995142,7cyclictest253936-21latency_hist22:10:011
73245995044,4cyclictest78300-21kworker/u8:1+events_unbound20:36:041
73245995044,4cyclictest67982-21kworker/u8:2+flush-8:020:56:031
73245995044,4cyclictest194532-21kworker/u8:4+events_unbound22:26:031
73241995043,5cyclictest284391-21apt-get22:40:510
73245994944,4cyclictest194532-21kworker/u8:4+events_unbound21:45:521
73245994944,4cyclictest189930-21kworker/u8:3+events_unbound21:31:071
73245994943,5cyclictest298314-21kworker/u8:1+flush-8:023:21:051
73245994942,5cyclictest189930-21kworker/u8:3+flush-8:023:11:041
73245994942,5cyclictest147066-21kworker/u8:0+flush-8:022:56:041
73241994945,3cyclictest3440679-21kworker/u8:3+events_unbound19:46:040
73241994940,6cyclictest224034-21latency_hist21:40:010
73245994842,4cyclictest3440679-21kworker/u8:3+events_unbound19:45:531
73245994841,5cyclictest147066-21kworker/u8:0+flush-8:022:51:121
73245994841,5cyclictest147066-21kworker/u8:0+events_unbound20:31:061
73241994845,2cyclictest8550irq/124-ahci[0000:00:12.0]22:01:050
73241994841,5cyclictest213210-21ntpq21:26:040
73247994741,4cyclictest67982-21kworker/u8:2+flush-8:020:51:032
73245994741,4cyclictest147066-21kworker/u8:0+events_unbound20:50:521
73245994640,5cyclictest147066-21kworker/u8:0+events_unbound20:41:071
73245994640,4cyclictest378762-21apt-get00:15:501
73245994640,4cyclictest378762-21apt-get00:15:501
73245994640,4cyclictest324084-21kworker/u8:0+flush-8:000:26:051
73245994639,5cyclictest324084-21kworker/u8:0+flush-8:023:31:041
73241994625,19cyclictest104991-21latency_hist19:40:000
73245994539,4cyclictest67982-21kworker/u8:2+flush-8:019:20:581
73245994538,5cyclictest303944-21kworker/u8:2+flush-8:023:06:051
73241994525,16cyclictest298768-21grep22:51:110
3578752450,3chrt75-21kworker/3:1-events23:51:103
73245994437,5cyclictest280-21systemd-journal00:06:351
73241994437,5cyclictest388652-21/usr/sbin/munin00:26:020
73241994427,14cyclictest198944-21grep21:11:100
73241994424,17cyclictest189274-21latency_hist21:05:000
73241994318,22cyclictest363363-21latency_hist00:00:010
73245994237,4cyclictest194532-21kworker/u8:4+events_unbound22:15:541
73245994235,5cyclictest189930-21kworker/u8:3+flush-8:000:31:061
73241994225,15cyclictest308663-21grep23:01:110
73241994222,18cyclictest164190-21unixbench_multi20:36:100
73241994222,17cyclictest234154-21latency_hist21:50:010
7324199421,11cyclictest589-21runrttasks23:06:060
73245994136,3cyclictest324084-21kworker/u8:0+events_unbound00:01:031
73245994136,3cyclictest147066-21kworker/u8:0+events_unbound21:36:101
73245994133,6cyclictest189930-21kworker/u8:3+flush-8:023:01:041
73241994136,3cyclictest67982-21kworker/u8:2+flush-8:020:21:050
73241994125,14cyclictest333398-21unixbench_singl23:26:110
73247994035,4cyclictest338868-21kworker/u8:2+events_unbound00:16:072
73247994035,4cyclictest338868-21kworker/u8:2+events_unbound00:16:072
73245994035,4cyclictest147066-21kworker/u8:0+flush-8:021:16:091
73245994033,5cyclictest338868-21kworker/u8:2+flush-8:000:21:061
73241994023,14cyclictest279145-21apt-key22:35:010
73245993933,4cyclictest189930-21kworker/u8:3+flush-8:021:11:041
73245993932,5cyclictest194532-21kworker/u8:4+flush-8:021:41:051
73245993932,5cyclictest194532-21kworker/u8:4+flush-8:021:41:051
73241993929,8cyclictest183411-21ntpq20:56:020
73241993924,13cyclictest143846-21needreboot20:16:010
73241993917,19cyclictest194303-21latency_hist21:10:010
2541022390,2sleep375-21kworker/3:1-events22:10:013
73247993834,3cyclictest194532-21kworker/u8:4+events_unbound22:31:082
73247993834,2cyclictest284069-21/usr/sbin/munin22:40:012
73247993832,4cyclictest368300-21apt-get00:05:012
73245993833,4cyclictest194532-21kworker/u8:4+flush-8:022:31:031
73245993831,5cyclictest353798-21apt-get23:50:491
73241993832,4cyclictest324226-21grep23:20:510
73241993831,5cyclictest393587-21/usr/sbin/munin00:31:020
73241993829,6cyclictest204253-21latency_hist21:20:000
73241993828,8cyclictest374058-21diskstats00:10:570
73241993822,14cyclictest159281-21unixbench_multi20:31:080
728672384,10sleep10-21swapper/119:07:291
73241993721,14cyclictest273578-21unixbench_singl22:26:080
73241993716,19cyclictest238756-21unixbench_singl21:51:120
73245993630,4cyclictest189930-21kworker/u8:3+events_unbound21:50:571
73245993629,5cyclictest194532-21kworker/u8:4+events_unbound22:40:551
7324199362,6cyclictest583-21snmpd19:20:500
73241993623,9cyclictest78128-21latency_hist19:15:010
73245993530,3cyclictest189930-21kworker/u8:3+flush-8:000:35:581
7324199355,25cyclictest0-21swapper/000:35:510
73241993512,21cyclictest218203-21ntpq21:31:030
73241993512,20cyclictest124266-21ntpq19:56:070
7324199350,11cyclictest1698152/usr/sbin/munin20:45:500
73245993429,3cyclictest67982-21kworker/u8:2+events_unbound21:05:011
73245993429,3cyclictest194532-21kworker/u8:4+events_unbound22:10:591
73241993417,15cyclictest0-21swapper/020:51:010
7324199333,3cyclictest0-21swapper/000:15:510
7324199333,3cyclictest0-21swapper/000:15:500
73241993326,5cyclictest109872-21grep19:41:110
7324199331,9cyclictest224365-21apt-get21:40:530
7324199331,9cyclictest224365-21apt-get21:40:530
73241993317,13cyclictest0-21swapper/023:40:520
73247993226,4cyclictest139456-21unixbench_multi20:11:122
7324199327,3cyclictest0-21swapper/023:35:510
7324199325,22cyclictest0-21swapper/021:20:540
7324199323,2cyclictest0-21swapper/019:50:510
73241993221,8cyclictest324084-21kworker/u8:0+flush-8:000:01:040
7324199321,8cyclictest99170-21/usr/sbin/munin19:31:020
7324199321,8cyclictest334073-21/usr/sbin/munin23:30:530
7324199321,8cyclictest283362-21/usr/sbin/munin22:36:080
73241993214,16cyclictest0-21swapper/022:50:010
73241993214,15cyclictest0-21swapper/022:15:500
73247993127,3cyclictest189930-21kworker/u8:3+events_unbound22:05:562
73247993126,4cyclictest189930-21kworker/u8:3+flush-8:021:46:042
73247993126,3cyclictest223624-21unixbench_multi21:36:112
73247993125,4cyclictest324084-21kworker/u8:0+flush-8:023:46:042
73247993125,4cyclictest324084-21kworker/u8:0+flush-8:023:46:042
73245993125,4cyclictest338868-21kworker/u8:2+flush-8:000:11:021
7324199319,3cyclictest383718-21/usr/sbin/munin00:20:570
7324199319,20cyclictest0-21swapper/023:10:550
7324199314,5cyclictest0-21swapper/020:05:510
73241993122,7cyclictest168651-21ntpq20:41:040
7324199311,9cyclictest139307-21/usr/sbin/munin20:11:100
73247993025,4cyclictest3440679-21kworker/u8:3+flush-8:019:46:002
73247993024,4cyclictest131215-21kthreadcore20:05:582
73245993025,4cyclictest324084-21kworker/u8:0+flush-8:023:41:101
73241993025,3cyclictest80452-21aten2_r5power_p19:15:520
7324199301,8cyclictest303272-21/usr/sbin/munin22:56:060
7324199301,8cyclictest243155-21ntpq21:56:040
73241993013,15cyclictest249661-21grep22:05:550
73241993012,16cyclictest0-21swapper/020:00:590
73241993011,17cyclictest0-21swapper/000:05:590
73247992920,7cyclictest85614-21fschecks_count19:20:542
73247992819,7cyclictest280-21systemd-journal21:00:002
73247992724,2cyclictest369066-21cpuspeed_turbos00:05:512
73247992724,2cyclictest334152-21aten2_r5power_v23:30:532
73247992723,2cyclictest199936-21fschecks_time21:15:562
73247992722,3cyclictest402819-21unixbench_singl00:36:112
73247992721,4cyclictest280-21systemd-journal21:35:002
73247992720,5cyclictest280-21systemd-journal22:59:592
7324799270,9cyclictest802801aten2_r5power_e19:15:062
73245992721,4cyclictest348866-21apt-get23:45:501
73245992721,4cyclictest348866-21apt-get23:45:501
7324199271,9cyclictest73236-21cyclictest19:10:010
73247992622,2cyclictest383963-21cpuspeed_turbos00:20:522
7324799261,23cyclictest229034-21munin-run21:45:002
7324799261,23cyclictest229034-21munin-run21:45:002
73247992520,4cyclictest78300-21kworker/u8:1+flush-8:019:34:232
7324799250,14cyclictest363392-21sendmail00:00:002
73247992419,3cyclictest339179-21cpuspeed_turbos23:35:542
73247992415,7cyclictest280-21systemd-journal23:04:352
73247992218,2cyclictest318523-21unixbench_multi23:11:092
73247992216,5cyclictest259237-21aten2_r5power_e22:15:532
73247992216,4cyclictest320160-21kthreadcore23:16:012
7324799220,8cyclictest264795-21irqcore22:20:562
7324799220,20cyclictest293994-21unin-run22:50:012
73247992118,2cyclictest73487-21aten2_r5power_c19:10:522
73247992118,2cyclictest234553-21aten2_r5power_p21:50:532
7324799211,10cyclictest248062-21grep22:01:012
73247992017,2cyclictest388710-21aten2_r5power_c00:25:522
73247992017,2cyclictest209572-21aten2_r5power_e21:25:532
73247992016,2cyclictest90781-21fschecks_count19:25:532
73247992016,2cyclictest0-21swapper/223:25:572
73247992016,2cyclictest0-21swapper/219:55:532
73247992012,6cyclictest193619-21systemctl21:06:082
73247992012,6cyclictest115844-21sort19:50:552
73247992011,7cyclictest140864-21sed20:15:552
727712204,12sleep20-21swapper/219:06:152
7324799199,7cyclictest324932-21sed23:20:572
73247991916,2cyclictest378459-21latency_hist00:15:002
73247991915,2cyclictest0-21swapper/219:40:012
73247991915,2cyclictest0-21swapper/200:35:012
73247991911,6cyclictest198397-21awk21:11:022
73247991911,6cyclictest169167-21head20:41:112
73247991910,7cyclictest355913-21tr23:50:592
73247991910,7cyclictest207310-21cut21:21:022
3726372193,5sleep30-21swapper/300:06:073
7324799189,7cyclictest150887-21sed20:25:562
7324799187,3cyclictest2544781cpuspeed_turbos22:10:532
7324799182,6cyclictest0-21swapper/222:28:442
7324799182,3cyclictest0-21swapper/220:39:162
73247991814,2cyclictest0-21swapper/222:40:562
73247991814,2cyclictest0-21swapper/221:56:092
73247991814,2cyclictest0-21swapper/221:05:002
73247991814,2cyclictest0-21swapper/220:20:542
73247991810,6cyclictest310813-21cut23:06:002
728242183,8sleep30-21swapper/319:06:563
7324799179,6cyclictest126282-21sed20:00:572
73247991713,2cyclictest0-21swapper/222:51:092
73247991712,3cyclictest0-21swapper/219:40:592
1698142170,6chrt0-21swapper/220:45:502
1297812172,4sleep30-21swapper/320:02:383
898722162,4sleep30-21swapper/319:24:143
73247991611,3cyclictest0-21swapper/220:30:592
1462862163,9sleep30-21swapper/320:21:003
1348992162,4sleep30-21swapper/320:09:403
1698042152,4sleep30-21swapper/320:45:443
1637122152,9sleep30-21swapper/320:36:033
778282141,4sleep30-21swapper/319:11:163
3823722142,8sleep30-21swapper/300:16:033
3823722142,8sleep30-21swapper/300:16:033
3773992143,7sleep30-21swapper/300:11:043
3129352142,8sleep30-21swapper/323:06:043
2298012140,4chrt481ktimers/321:45:543
1673952143,7sleep30-21swapper/320:41:023
2742422132,7sleep30-21swapper/322:30:493
1992942132,6sleep30-21swapper/321:15:013
1929462133,6sleep30-21swapper/321:06:023
1500172131,4sleep30-21swapper/320:25:413
1398652132,6sleep30-21swapper/320:15:023
1058392132,7sleep30-21swapper/319:40:553
947012122,6sleep30-21swapper/319:26:103
812502122,6sleep30-21swapper/319:15:593
3989002122,6sleep30-21swapper/300:35:573
3981652122,6sleep30-21swapper/300:34:373
3891822122,6sleep30-21swapper/300:25:583
3635122122,6sleep30-21swapper/300:00:013
3488702123,5sleep30-21swapper/323:45:533
3488702123,5sleep30-21swapper/323:45:523
3386852122,5sleep30-21swapper/323:35:023
3246222122,7sleep30-21swapper/323:20:573
3217372122,6sleep30-21swapper/323:16:033
3139882122,5sleep30-21swapper/323:10:023
3014812122,6sleep30-21swapper/322:56:013
2890292122,5sleep30-21swapper/322:45:023
2793032122,5sleep30-21swapper/322:35:023
2595522122,6sleep30-21swapper/322:15:563
2459782122,6sleep30-21swapper/322:01:003
2394192122,6sleep30-21swapper/321:55:543
2246512122,6sleep30-21swapper/321:40:573
2246512122,6sleep30-21swapper/321:40:563
2148852122,6sleep30-21swapper/321:30:583
2132032122,6sleep30-21swapper/321:26:033
2035092122,6sleep30-21swapper/321:16:093
1752462122,6sleep30-21swapper/320:50:563
1572862122,6sleep30-21swapper/320:30:593
1388822122,6sleep30-21swapper/320:11:043
1242752122,6sleep30-21swapper/319:56:083
1153552122,6sleep30-21swapper/319:50:023
1105392123,5sleep30-21swapper/319:45:513
1000392122,5sleep30-21swapper/319:35:013
958352112,5sleep30-21swapper/319:30:553
3837472112,5sleep30-21swapper/300:20:523
3586302112,6sleep30-21swapper/323:55:073
3439052112,5sleep30-21swapper/323:40:513
3343852112,6sleep30-21swapper/323:30:553
3290152112,5sleep30-21swapper/323:25:023
3043182112,5sleep30-21swapper/323:00:023
2944672112,5sleep30-21swapper/322:50:513
2852752112,5sleep30-21swapper/322:40:593
2697382112,6sleep30-21swapper/322:25:543
2638412112,5sleep30-21swapper/322:20:023
2541022112,5sleep30-21swapper/322:10:023
2351792112,5sleep30-21swapper/321:50:593
2196552111,6sleep30-21swapper/321:35:563
2044892112,5sleep30-21swapper/321:20:023
1850562112,5sleep30-21swapper/321:00:563
1796312112,5sleep30-21swapper/320:55:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional