You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-20 - 20:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Sat Dec 20, 2025 12:44:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28539752860,1sleep02853980-21tr11:44:060
26542122530,5chrt0-21swapper/208:24:022
29076832450,4sleep30-21swapper/312:39:063
2581797994434,8cyclictest278-21systemd-journal12:30:001
2581797994434,8cyclictest278-21systemd-journal12:30:001
2581793994437,5cyclictest2697646-21kworker/u8:2+flush-8:009:18:590
2581793994437,5cyclictest2392291-21kworker/u8:2+flush-8:007:18:590
2581793994436,5cyclictest2736773-21latency_hist09:45:010
2581793994334,7cyclictest2667614-21latency_hist08:35:000
28912472380,2sleep3471rcuc/312:24:063
2581797993525,8cyclictest278-21systemd-journal12:19:091
2581797993525,8cyclictest2765692-21ntpq10:14:071
2581793993530,4cyclictest2751922-40mandb10:02:100
2581793993524,8cyclictest2652601-21latency_hist08:20:000
2581797993424,7cyclictest2642751-21latency_hist08:10:011
2581793993426,6cyclictest2718001-21grep09:29:000
2581793993422,10cyclictest2673575-21diskstats08:43:590
2581793993422,10cyclictest2673575-21diskstats08:43:580
2581797993327,4cyclictest2865192-21cron11:55:001
2581797993325,5cyclictest2608210-21latency_hist07:35:011
258179399331,29cyclictest411-21dbus-daemon12:05:010
2581797993224,6cyclictest278-21systemd-journal12:04:401
2581793993227,4cyclictest2746616-21kworker/u8:1+events_unbound11:08:570
2581793993227,3cyclictest20643-21cron07:55:000
2581793993224,6cyclictest2642998-21kworker/u8:0+flush-8:008:49:000
2581800993110,9cyclictest0-21swapper/209:55:002
2581793993122,6cyclictest2864543-21ntpq11:54:100
25771902314,9sleep20-21swapper/207:06:592
2581797993025,3cyclictest2850424-21cron11:40:011
2581797993025,3cyclictest1-21systemd11:09:091
2581797993024,5cyclictest2392291-21kworker/u8:2+flush-8:007:39:001
2581793993025,4cyclictest2860289-21kworker/u8:3+flush-8:012:13:580
2581793993024,4cyclictest2830699-21cron11:20:000
2581793993024,4cyclictest2830699-21cron11:20:000
2581793993021,6cyclictest2845522-21latency_hist11:35:010
2581797992922,6cyclictest2836278-21aten2_r5power_p11:28:581
2581797992921,6cyclictest2746511-21unixbench_singl09:54:181
2581793992924,3cyclictest2677555-21kworker/u8:1+flush-8:008:54:010
2581793992922,5cyclictest2810646-21unixbench_multi10:59:170
2581793992920,6cyclictest2835643-21latency_hist11:25:000
2581793992918,8cyclictest2586036-21ntpq07:14:080
2581797992824,2cyclictest0-21swapper/108:35:001
2581797992822,4cyclictest2622888-21unixbench_singl07:49:151
2581797992819,7cyclictest2652605-21apt08:20:001
2581797992818,8cyclictest278-21systemd-journal08:05:001
2581793992824,2cyclictest2879283-21needreboot12:09:040
2581793992823,3cyclictest2741650-21cron09:50:000
2581793992823,3cyclictest2608223-21systemd-run07:35:010
2581793992821,5cyclictest2624678-21kworker/u8:2+flush-8:007:59:030
2581793992820,6cyclictest2766294-21latency_hist10:15:020
2581800992724,2cyclictest2747231-21aten2_r5power_p09:58:562
2581800992724,2cyclictest2582292-21aten2_r5power_c07:13:562
2581800992720,5cyclictest2678240-21apt-get08:48:552
2581797992723,2cyclictest2835664-21systemd-run11:25:011
2581797992721,4cyclictest2767215-21fschecks_time10:19:001
2581797992719,6cyclictest2717653-21apt-get09:28:551
2581793992724,2cyclictest2908808-21needreboot12:39:080
2581793992722,2cyclictest0-21swapper/010:00:000
258180099268,3cyclictest26700482cut08:39:052
2581800992622,2cyclictest2702148-21unixbench_multi09:09:152
2581800992622,2cyclictest2628696-21cpuspeed_turbos07:58:582
258180099260,9cyclictest2813004-21cut11:04:062
2581797992623,2cyclictest2876209-21irqcore12:09:001
2581797992622,3cyclictest2642998-21kworker/u8:0+flush-8:008:49:121
2581797992621,4cyclictest2790975-21unixbench_singl10:39:151
2581797992621,4cyclictest2598294-21unixbench_singl07:24:151
2581797992621,4cyclictest2598294-21unixbench_singl07:24:151
2581797992620,4cyclictest2860289-21kworker/u8:3+flush-8:012:24:161
2581797992620,4cyclictest2781237-21cron10:30:001
258179399266,18cyclictest2657798-21kworker/0:0+events09:13:290
258179399265,18cyclictest2850485-21kworker/0:0+events12:30:130
258179399262,20cyclictest2657798-21kworker/0:0+events09:35:250
2581793992621,4cyclictest0-21swapper/011:14:090
2581793992611,12cyclictest278-21systemd-journal08:29:150
26700452250,1sleep02670048-21cut08:39:050
258180099256,2cyclictest27042672kthreadcore09:14:042
2581800992522,2cyclictest2870720-21aten2_r5power_e12:03:562
2581800992522,2cyclictest2767064-21cpuspeed_turbos10:18:592
258180099250,10cyclictest2626501-21tr07:54:052
2581797992521,3cyclictest2802222-21irqrtprio10:54:021
2581797992521,2cyclictest0-21swapper/112:14:091
2581797992521,2cyclictest0-21swapper/111:00:001
2581797992521,2cyclictest0-21swapper/109:39:001
2581797992521,2cyclictest0-21swapper/108:00:011
2581797992520,4cyclictest2756326-21unixbench_multi10:04:141
2581797992520,4cyclictest2722012-21kworker/u8:3+events_unbound09:58:571
2581797992520,4cyclictest2603192-21unixbench_singl07:29:181
2581797992520,3cyclictest2904503-21unixbench_singl12:34:161
2581797992519,5cyclictest2716967-21unixbench_multi09:24:151
2581797992518,5cyclictest278-21systemd-journal09:09:211
2581797992518,5cyclictest2695170-21kthreadcore09:04:031
258179399256,18cyclictest2781264-21kworker/0:1+events10:44:060
258179399252,22cyclictest2613194-21kworker/0:1+events08:20:010
258179399252,22cyclictest0-21swapper/009:24:130
2581793992520,3cyclictest2697255-21unixbench_singl09:04:140
2581793992520,3cyclictest0-21swapper/009:35:000
258180099242,7cyclictest0-21swapper/211:29:062
258180099242,7cyclictest0-21swapper/211:17:462
258180099242,7cyclictest0-21swapper/211:17:462
2581800992421,2cyclictest2717739-21aten2_r5power_p09:28:582
2581800992420,3cyclictest2766293-21turbostat.cron10:15:002
2581800992420,2cyclictest2800832-21unixbench_singl10:49:152
258180099240,8cyclictest2779249-21kthreadcore10:29:042
258180099240,13cyclictest2861885-21grep11:54:072
2581797992419,3cyclictest2786060-21unixbench_singl10:34:151
2581797992419,3cyclictest2733132-21irqrtprio09:44:041
2581797992419,3cyclictest0-21swapper/111:58:581
2581797992419,3cyclictest0-21swapper/107:45:021
258179399244,19cyclictest2781264-21kworker/0:1+events10:33:450
258179399242,21cyclictest2781264-21kworker/0:1+events11:37:050
258179399242,21cyclictest2657798-21kworker/0:0+events09:51:210
258179399242,20cyclictest0-21swapper/010:29:130
2581793992421,2cyclictest2701618-21needreboot09:09:060
2581793992421,2cyclictest2603325-21systemd-run07:30:000
2581793992420,3cyclictest1574759-21kworker/u8:1+events_unbound07:39:130
2581793992420,2cyclictest0-21swapper/007:24:050
2581793992420,2cyclictest0-21swapper/007:24:050
2581793992419,3cyclictest2899534-21unixbench_multi12:29:150
2581793992419,3cyclictest2899534-21unixbench_multi12:29:150
2581793992419,3cyclictest2633958-21sort08:04:030
2581793992416,5cyclictest2613416-21kworker/u8:3+flush-8:007:44:090
2581793992414,8cyclictest2643546-21diskstats08:13:590
2581793992413,7cyclictest278-21systemd-journal12:24:090
258180099239,2cyclictest161rcu_preempt07:48:572
258180099233,4cyclictest0-21swapper/208:14:152
2581800992320,2cyclictest2884888-21cron12:15:002
2581800992320,2cyclictest2736776-21basename09:45:002
2581800992318,4cyclictest2810691-21unixbench_singl10:59:162
2581800992317,4cyclictest2909346-21unixbench_multi12:39:162
2581800992313,8cyclictest2776415-21cat10:25:012
2581800992311,3cyclictest0-21swapper/211:59:062
258180099230,7cyclictest39-21ksoftirqd/211:09:032
2581797992319,3cyclictest2707277-21cron09:15:001
2581797992319,2cyclictest0-21swapper/110:25:001
2581797992318,3cyclictest2841354-21cpuspeed_turbos11:33:581
2581797992318,3cyclictest2688835-21irqrtprio08:59:031
2581797992318,3cyclictest0-21swapper/111:45:011
2581797992316,5cyclictest0-21swapper/107:19:011
2581797992314,4cyclictest2645585-21kthreadcore08:14:051
258179399234,18cyclictest2781264-21kworker/0:1+events11:03:490
258179399232,19cyclictest2657798-21kworker/0:0+events10:21:050
2581793992318,3cyclictest0-21swapper/008:58:580
258179399231,21cyclictest2850485-21kworker/0:0+events11:56:090
2581793992310,5cyclictest0-21swapper/010:09:040
258179399230,22cyclictest2850485-21kworker/0:0+events12:17:570
25770762232,5sleep00-21swapper/007:05:290
258180099223,4cyclictest0-21swapper/207:44:022
258180099222,8cyclictest161rcu_preempt08:29:082
258180099222,6cyclictest0-21swapper/211:45:102
258180099222,6cyclictest0-21swapper/209:30:092
258180099222,6cyclictest0-21swapper/207:29:232
258180099222,4cyclictest0-21swapper/211:44:102
258180099222,4cyclictest0-21swapper/208:50:452
258180099221,7cyclictest2793434-21cut10:44:062
258180099220,7cyclictest2845046-21awk11:34:122
258180099220,6cyclictest2676768-21cut08:44:062
258180099220,6cyclictest2676768-21cut08:44:052
258180099220,12cyclictest2652742-21apt-config08:20:002
2581797992219,2cyclictest904-21mta-sts-daemon08:44:011
2581797992219,2cyclictest904-21mta-sts-daemon08:44:011
2581797992218,3cyclictest2825288-21proc_pri11:14:111
2581797992218,3cyclictest2642998-21kworker/u8:0+flush-8:008:39:211
2581797992218,2cyclictest2909514-21cron12:40:001
2581797992218,2cyclictest0-21swapper/111:04:051
2581797992218,2cyclictest0-21swapper/110:44:041
2581797992217,4cyclictest2658903-21irqcore08:29:031
2581797992217,3cyclictest0-21swapper/107:53:591
2581797992216,5cyclictest2796792-21cpuspeed_turbos10:48:571
2581797992216,4cyclictest2585506-21kthreadcore07:14:051
2581797992216,4cyclictest0-21swapper/111:49:131
2581797992214,6cyclictest278-21systemd-journal09:16:091
258179399226,15cyclictest2781264-21kworker/0:1+events10:50:170
2581793992213,7cyclictest2796819-21diskstats10:48:580
258179399221,20cyclictest2850485-21kworker/0:0+events11:48:570
258179399221,20cyclictest2613194-21kworker/0:1+events08:06:370
25816052224,13sleep10-21swapper/107:09:391
258180099217,4cyclictest2846932-21sed11:39:032
258180099214,3cyclictest161rcu_preempt10:34:092
258180099212,4cyclictest0-21swapper/212:24:072
258180099212,4cyclictest0-21swapper/209:49:042
258180099212,4cyclictest0-21swapper/209:39:032
258180099212,4cyclictest0-21swapper/209:04:132
258180099212,4cyclictest0-21swapper/208:34:012
258180099212,4cyclictest0-21swapper/208:04:132
258180099212,1cyclictest0-21swapper/207:19:052
2581800992117,2cyclictest0-21swapper/209:00:002
258180099211,5cyclictest0-21swapper/210:04:112
2581800992110,3cyclictest0-21swapper/207:23:572
2581800992110,3cyclictest0-21swapper/207:23:572
258180099210,8cyclictest2898283-21cut12:29:052
258180099210,8cyclictest2898283-21cut12:29:052
2581797992117,2cyclictest0-21swapper/111:19:111
2581797992117,2cyclictest0-21swapper/111:19:111
2581797992117,2cyclictest0-21swapper/109:34:021
2581797992116,3cyclictest0-21swapper/109:49:141
2581797992114,6cyclictest2687446-21unixbench_singl08:54:161
2581797992113,6cyclictest2760757-21ntpq10:09:081
258179399218,9cyclictest2767195-21grep10:19:000
258179399215,15cyclictest2613194-21kworker/0:1+events07:48:250
27717572203,12sleep30-21swapper/310:23:573
258180099208,1cyclictest161rcu_preempt07:35:542
258180099203,4cyclictest0-21swapper/212:34:002
258180099202,5cyclictest0-21swapper/210:54:002
258180099202,4cyclictest0-21swapper/210:38:592
258180099202,4cyclictest0-21swapper/210:09:032
258180099202,4cyclictest0-21swapper/209:24:142
258180099202,4cyclictest0-21swapper/208:06:002
2581800992017,2cyclictest371rcuc/212:08:332
2581800992011,2cyclictest161rcu_preempt09:18:132
258180099200,5cyclictest2825219-21ntpq11:14:092
258180099200,11cyclictest39-21ksoftirqd/211:24:032
258180099200,11cyclictest2605621-21cut07:34:052
2581797992016,2cyclictest0-21swapper/108:24:121
258179399201,16cyclictest2840589-21basename11:30:000
258179399201,16cyclictest2787313-21sort10:39:020
26782422192,10sleep30-21swapper/308:48:563
258180099192,4cyclictest0-21swapper/212:15:442
25773712193,8sleep30-21swapper/307:08:573
26571052155,6sleep30-21swapper/308:24:083
27817922142,7sleep30-21swapper/310:33:563
26916412142,8sleep30-21swapper/308:59:073
26675982140,10sleep30-21swapper/308:35:003
26471482142,8sleep30-21swapper/308:14:133
28648282133,6sleep30-21swapper/311:54:173
28258182132,6sleep30-21swapper/311:15:013
28258182132,6sleep30-21swapper/311:15:013
29013912122,6sleep30-21swapper/312:34:053
28955422122,6sleep30-21swapper/312:29:003
28955422122,6sleep30-21swapper/312:29:003
28841972122,6sleep30-21swapper/312:14:073
28726472122,6sleep30-21swapper/312:04:043
28652302122,6sleep30-21swapper/311:55:013
28498832122,6sleep30-21swapper/311:39:123
28451742122,6sleep30-21swapper/311:34:153
28365382122,6sleep30-21swapper/311:29:023
28351172123,5sleep30-21swapper/311:24:123
28214102122,6sleep30-21swapper/311:13:573
28119792122,6sleep30-21swapper/311:04:023
28009802122,6sleep30-21swapper/310:50:013
27768712122,6sleep30-21swapper/310:28:553
27573662122,6sleep30-21swapper/310:09:013
27562892122,6sleep30-21swapper/310:04:153
27511192122,6sleep30-21swapper/309:59:143
27459782122,6sleep30-21swapper/309:54:123
27275042122,6sleep30-21swapper/309:38:553
27249832122,6sleep30-21swapper/309:34:063
27214532122,6sleep30-21swapper/309:29:123
27126562122,6sleep30-21swapper/309:23:103
27037542122,6sleep30-21swapper/309:14:043
26984092122,6sleep30-21swapper/309:09:023
26967732122,7sleep30-21swapper/309:04:093
26830882122,6sleep30-21swapper/308:53:093
26720812122,6sleep30-21swapper/308:39:093
26481402123,5sleep30-21swapper/308:18:183
26328452122,5sleep30-21swapper/308:00:013
26276512122,6sleep30-21swapper/307:54:153
26184642123,5sleep30-21swapper/307:47:023
26026442122,6sleep30-21swapper/307:29:113
28858222112,5sleep30-21swapper/312:19:013
28793172112,5sleep30-21swapper/312:09:063
28556302113,5sleep30-21swapper/311:45:383
28509992112,5sleep30-21swapper/311:43:583
28163282112,5sleep30-21swapper/311:07:073
28065592112,5sleep30-21swapper/310:59:003
27970392112,5sleep30-21swapper/310:49:013
27913812113,5sleep30-21swapper/310:40:583
27906852112,5sleep30-21swapper/310:39:143
27704872112,5sleep30-21swapper/310:19:083
27616362112,6sleep30-21swapper/310:10:253
27367992111,6sleep30-21swapper/309:45:013
27322892112,5sleep30-21swapper/309:42:413
27083202112,5sleep30-21swapper/309:19:023
26728212112,5sleep30-21swapper/308:40:013
26728212112,5sleep30-21swapper/308:40:013
26580232113,5sleep30-21swapper/308:25:293
26380422112,6sleep30-21swapper/308:05:223
26331102112,6sleep30-21swapper/308:00:093
26134962113,5sleep30-21swapper/307:41:353
26118732112,6sleep30-21swapper/307:39:063
26038152112,6sleep30-21swapper/307:33:493
25944032112,5sleep30-21swapper/307:24:023
25944032112,5sleep30-21swapper/307:24:023
25934432110,6sleep30-21swapper/307:20:013
25824992112,5sleep30-21swapper/307:13:593
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional