You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-22 - 21:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Mon Dec 22, 2025 12:44:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2256082995638,14cyclictest2371924-21latency_hist09:05:010
2256092995240,10cyclictest2361878-21cp08:55:012
23942932510,3sleep3575-21kworker/3:2+events09:29:033
2256088995143,6cyclictest2272677-21kworker/u8:2+flush-8:007:49:131
2256088995043,5cyclictest2570441-21kworker/u8:1+flush-8:012:39:131
2256088994943,4cyclictest2297623-21kworker/u8:3+events_unbound08:39:141
2256088994939,7cyclictest2406372-21latency_hist09:40:011
2256082994838,7cyclictest2505488-21latency_hist11:20:010
2256088994742,3cyclictest2401458-21kworker/u8:3+flush-8:009:44:141
2256088994740,5cyclictest2470524-21kworker/u8:0+events_unbound11:09:131
225608299473,38cyclictest0-21swapper/010:48:530
2256082994723,21cyclictest2307450-21latency_hist08:00:010
2256082994527,15cyclictest278-21systemd-journal10:20:000
2256092994333,7cyclictest278-21systemd-journal07:25:002
225115224328,10sleep10-21swapper/107:05:371
2256092994231,8cyclictest2366940-21awk09:00:002
2256088994135,4cyclictest2386896-21kworker/u8:2+flush-8:010:45:011
2256092994028,9cyclictest278-21systemd-journal12:14:122
2256092994028,9cyclictest278-21systemd-journal12:14:112
2256088994036,3cyclictest2515784-21kworker/u8:1+flush-8:011:53:581
2256088994033,5cyclictest2386896-21kworker/u8:2+flush-8:009:24:111
2256082994021,17cyclictest2401429-21sh09:35:000
2256082994016,21cyclictest2564887-21ntpq12:24:060
2256082994011,9cyclictest2407182-21diskstats09:43:580
2256088993934,4cyclictest2386896-21kworker/u8:2+events_unbound10:54:001
2256082993923,14cyclictest2490482-21awk11:05:000
2256082993912,6cyclictest2515364-21basename11:30:000
2256088993833,3cyclictest2401458-21kworker/u8:3+events_unbound10:14:091
2256082993830,6cyclictest2272736-21latency_hist07:25:000
2256082993822,14cyclictest2289775-21kthreadcore07:44:020
2256082993813,22cyclictest2282605-21apt-get07:35:010
225608299381,12cyclictest573-21snmpd09:28:540
2256088993733,3cyclictest2386896-21kworker/u8:2+events_unbound11:24:041
2256088993732,4cyclictest2544832-21kworker/u8:0+flush-8:012:04:121
2256088993732,3cyclictest2193031-21kworker/u8:1+flush-8:008:34:131
2256088993727,8cyclictest2316934-21ntpq08:09:071
2256082993730,5cyclictest2549846-21latency_hist12:05:010
2256082993715,20cyclictest2550604-21apt-key12:10:000
2256088993631,4cyclictest2401458-21kworker/u8:3+events_unbound10:34:121
2256088993631,3cyclictest2515784-21kworker/u8:1+flush-8:011:49:141
2256088993631,3cyclictest2272677-21kworker/u8:2+events_unbound07:54:001
2256088993626,8cyclictest2292034-21ntpq07:44:061
2256082993620,14cyclictest2391431-21unixbench_multi09:24:130
2256088993530,4cyclictest2272677-21kworker/u8:2+events_unbound07:29:001
2256088993530,3cyclictest2544832-21kworker/u8:0+events_unbound12:30:001
2256082993518,15cyclictest20643-21cron08:55:000
2256082993517,16cyclictest2327343-21cron08:20:000
2256082993515,18cyclictest0-21swapper/008:05:000
2256088993429,4cyclictest2455823-21kworker/u8:1+flush-8:010:59:141
2256088993429,4cyclictest2386896-21kworker/u8:2+flush-8:011:28:571
2256088993428,5cyclictest2470524-21kworker/u8:0+flush-8:010:49:091
225608299342,9cyclictest2336568-21ntpq08:29:050
2256082993424,8cyclictest2446503-21/usr/sbin/munin10:24:070
2256082993418,14cyclictest0-21swapper/011:13:590
2256082993417,15cyclictest0-21swapper/007:19:050
2256082993416,16cyclictest2385022-21kthreadcore09:19:020
2256082993415,17cyclictest0-21swapper/012:14:070
2256082993415,17cyclictest0-21swapper/012:14:070
2256082993413,19cyclictest0-21swapper/012:39:080
2256082993412,5cyclictest2287828-21systemd-run07:40:010
2256092993330,2cyclictest2561646-21grep12:23:582
2256092993323,8cyclictest2495782-21cat11:10:002
2256088993327,4cyclictest2351955-21idleruntime-cro08:45:001
2256088993327,4cyclictest2351955-21idleruntime-cro08:45:001
2256088993324,7cyclictest2565513-21latency_hist12:25:011
225608299332,8cyclictest573-21snmpd09:13:540
2256082993317,14cyclictest0-21swapper/011:08:550
2256082993316,15cyclictest0-21swapper/012:19:030
2256082993314,17cyclictest0-21swapper/008:09:040
2256082993313,1cyclictest0-21swapper/011:49:140
2256082993313,18cyclictest2460592-21unixbench_multi10:34:130
2256082993313,18cyclictest0-21swapper/010:43:580
225608299331,27cyclictest2302555-21kworker/0:0+events08:56:190
225608299331,12cyclictest2440423-21ntpq10:14:050
2256088993227,4cyclictest2297623-21kworker/u8:3+events_unbound09:18:571
225608299322,2cyclictest2328802-21cut08:24:010
225608299322,12cyclictest2404416-21kthreadcore09:39:000
225608299322,11cyclictest2356175-21ntpq08:49:050
225608299321,8cyclictest2346427-21ntpq08:39:100
2256082993217,13cyclictest2435463-21ntp_kernel_err10:09:070
2256082993217,12cyclictest0-21swapper/007:14:080
2256082993214,16cyclictest2318347-21diskstats08:13:580
2256082993214,15cyclictest0-21swapper/007:28:550
225608299321,10cyclictest2376221-21ntpq09:09:060
225608299321,10cyclictest2341535-21ntpq08:34:080
2256082993210,4cyclictest2453282-21kthreadcore10:29:040
2256092993124,5cyclictest278-21systemd-journal09:36:122
2256088993127,2cyclictest2284122-21irqrtprio07:38:581
2256088993126,4cyclictest2367421-21kworker/u8:0+flush-8:010:29:031
2256088993126,3cyclictest2470524-21kworker/u8:0+events_unbound11:05:001
2256088993126,3cyclictest2257194-21irqcore07:14:021
225608299318,8cyclictest2506297-21diskstats11:23:560
2256082993117,12cyclictest0-21swapper/012:29:020
2256082993114,15cyclictest0-21swapper/012:34:060
2256082993114,15cyclictest0-21swapper/007:54:030
225608299311,12cyclictest25357522cpu11:53:560
2256082993110,3cyclictest0-21swapper/009:54:020
2256082993110,3cyclictest0-21swapper/009:54:020
2256092993025,3cyclictest2312236-21grep08:04:132
2256088993026,3cyclictest2515784-21kworker/u8:1+flush-8:011:39:031
2256088993026,3cyclictest2193031-21kworker/u8:1+events_unbound08:29:111
2256088993024,4cyclictest2446528-21apt-get10:23:551
2256088993022,6cyclictest2396516-21latency_hist09:30:011
2256082993013,15cyclictest0-21swapper/011:38:570
2256082993011,3cyclictest0-21swapper/008:44:040
2256082993011,3cyclictest0-21swapper/008:44:040
225608299301,11cyclictest2425713-21ntpq09:59:090
2256092992925,3cyclictest2544832-21kworker/u8:0+events_unbound12:00:032
2256092992925,3cyclictest2297623-21kworker/u8:3+events_unbound07:55:122
2256092992925,2cyclictest2571286-21fschecks_time12:34:002
2256088992924,4cyclictest2386896-21kworker/u8:2+flush-8:010:39:081
2256088992924,3cyclictest2520170-21unixbench_multi11:34:131
225608299299,5cyclictest2412457-21cut09:48:580
225608299291,7cyclictest2475542-21apt-get10:50:030
2256082992914,12cyclictest0-21swapper/010:59:080
2256082992912,2cyclictest0-21swapper/011:34:020
2256082992911,2cyclictest0-21swapper/011:43:580
2256092992824,2cyclictest2461370-21aten2_r5power_e10:38:552
2256092992818,8cyclictest2426300-21awk10:00:002
2256088992823,3cyclictest2570441-21kworker/u8:1+flush-8:012:34:141
2256088992823,3cyclictest2367421-21kworker/u8:0+events_unbound10:19:121
2256088992822,4cyclictest2515784-21kworker/u8:1+events_unbound11:44:051
2256088992821,5cyclictest2297623-21kworker/u8:3+events_unbound09:04:101
2256088992821,5cyclictest2193031-21kworker/u8:1+events_unbound08:59:061
2256088992820,6cyclictest2540766-21grep11:58:561
2256088992819,7cyclictest2376152-21ntpq09:09:051
2256088992813,14cyclictest1-21systemd12:14:111
2256088992813,14cyclictest1-21systemd12:14:111
225608299289,3cyclictest2255763-21latency_hist07:10:010
2256082992813,13cyclictest0-21swapper/007:48:550
2256082992810,16cyclictest0-21swapper/011:59:030
2256092992724,2cyclictest2381721-21cron09:15:002
2256092992723,3cyclictest2515784-21kworker/u8:1+flush-8:011:34:112
2256092992723,3cyclictest2193031-21kworker/u8:1+events_unbound07:29:042
2256092992723,2cyclictest2506312-21fschecks_count11:23:572
2256092992722,3cyclictest2431853-21aten2_r5power_p10:08:562
225609299270,15cyclictest2282646-21runrttasks07:35:012
2256088992723,3cyclictest2498337-21kthreadcore11:14:041
2256088992723,3cyclictest2297623-21kworker/u8:3+events_unbound09:14:091
2256088992722,4cyclictest2401458-21kworker/u8:3+events_unbound10:03:571
2256088992721,5cyclictest2272677-21kworker/u8:2+flush-8:008:54:131
2256088992719,6cyclictest2272677-21kworker/u8:2+events_unbound08:19:081
225608299278,5cyclictest2464511-21cut10:39:030
2256092992623,2cyclictest2521175-21fschecks_count11:38:592
2256092992623,2cyclictest2397356-21fschecks_count09:33:592
2256088992621,4cyclictest2297623-21kworker/u8:3+flush-8:008:14:121
2256088992620,4cyclictest2356686-21unixbench_multi08:49:141
2256088992620,4cyclictest2193031-21kworker/u8:1+flush-8:007:19:151
2256088992619,6cyclictest2282497-21unixbench_singl07:34:151
225608299269,3cyclictest0-21swapper/010:04:010
2256092992522,2cyclictest2471400-21fschecks_count10:48:582
2256092992522,2cyclictest2412131-21aten2_r5power_c09:48:552
2256092992520,3cyclictest2321759-21grep08:14:052
2256088992520,3cyclictest2544832-21kworker/u8:0+events_unbound12:19:131
22557422259,10sleep22255808-21apt-config07:10:002
225609299246,6cyclictest2513917-21cut11:29:022
2256092992421,2cyclictest2535856-21cpuspeed_turbos11:53:562
2256092992421,2cyclictest2505310-21unixbench_multi11:19:132
2256092992421,2cyclictest2417121-21aten2_r5power_v09:53:552
2256092992421,2cyclictest2417121-21aten2_r5power_v09:53:552
2256092992421,2cyclictest2352560-21aten2_r5power_e08:48:552
2256092992420,2cyclictest2451728-21fschecks_count10:28:592
2256088992420,3cyclictest2367421-21kworker/u8:0+events_unbound09:59:111
225609299239,2cyclictest161rcu_preempt10:58:072
225609299237,3cyclictest24374502irqrtprio10:13:592
225609299237,3cyclictest161rcu_preempt11:44:032
225609299237,3cyclictest161rcu_preempt09:45:002
225609299234,9cyclictest2490065-21mailstats11:04:112
225609299232,5cyclictest0-21swapper/210:34:012
2256092992320,2cyclictest2376823-21munin-plugin-st09:10:002
2256092992319,2cyclictest0-21swapper/207:40:002
225609299230,6cyclictest2445841-21sed10:19:122
225609299230,14cyclictest20643-21cron08:20:002
2256088992319,3cyclictest0-21swapper/108:04:131
225609299229,2cyclictest161rcu_preempt10:40:332
225609299227,2cyclictest161rcu_preempt08:08:512
225609299226,2cyclictest161rcu_preempt12:30:012
225609299221,11cyclictest2560559-21munin-run12:20:002
2256092992210,2cyclictest161rcu_preempt10:51:082
2256092992210,2cyclictest161rcu_preempt08:34:022
225609299220,4cyclictest2328800-21irqrtprio08:24:012
225609299220,13cyclictest2541445-21cut11:59:012
225609299220,12cyclictest2391606-21munin-run09:25:002
225609299220,12cyclictest2371826-21unixbench_singl09:04:132
225609299220,10cyclictest2580288-21idleruntime-cro12:40:002
225609299220,10cyclictest2261145-21sed07:15:002
2256088992218,3cyclictest2367421-21kworker/u8:0+events_unbound09:53:561
2256088992218,3cyclictest2367421-21kworker/u8:0+events_unbound09:53:561
2256088992217,3cyclictest2269294-21kthreadcore07:24:021
2256088992216,5cyclictest2455823-21kworker/u8:1+events_unbound11:16:221
225609299214,4cyclictest2393560-21cut09:29:022
225609299212,10cyclictest0-21swapper/211:49:012
225609299210,4cyclictest2302519-21apt07:55:002
225609299210,10cyclictest2550615-21apt-config12:10:002
225608899217,5cyclictest0-21swapper/110:06:351
2256088992117,2cyclictest0-21swapper/107:58:531
2256088992116,4cyclictest2550916-21apt-key12:10:011
2256088992116,3cyclictest2416319-21unixbench_multi09:49:131
225609299209,2cyclictest161rcu_preempt08:25:592
225609299208,2cyclictest161rcu_preempt08:37:432
225609299203,7cyclictest2250901-21kworker/2:1-events07:49:032
225609299203,2cyclictest0-21swapper/207:15:032
225609299203,1cyclictest0-21swapper/208:44:142
225609299203,1cyclictest0-21swapper/208:44:142
2256092992016,2cyclictest0-21swapper/211:14:032
225609299200,10cyclictest2450909-21cron10:25:002
2256088992014,4cyclictest2367421-21kworker/u8:0+events_unbound09:34:021
2256088992014,4cyclictest0-21swapper/108:24:011
225609299193,2cyclictest161rcu_preempt10:04:032
225609299192,8cyclictest0-21swapper/207:45:012
225609299190,6cyclictest2384894-21kthreadcore09:19:022
22516662194,8sleep30-21swapper/307:08:573
25767052178,5sleep30-21swapper/312:39:033
24455712143,7sleep30-21swapper/310:19:123
25400282132,6sleep30-21swapper/311:55:013
25065362132,7sleep30-21swapper/311:24:013
24756012132,6sleep30-21swapper/310:50:023
24502642133,6sleep30-21swapper/310:24:093
24354872132,7sleep30-21swapper/310:09:093
24204872132,7sleep30-21swapper/309:54:043
24204872132,7sleep30-21swapper/309:54:043
24113022134,5sleep30-21swapper/309:44:573
23719122134,5sleep30-21swapper/309:05:013
23331422130,6sleep30-21swapper/308:28:563
22976192132,6sleep30-21swapper/307:50:013
25713502122,6sleep30-21swapper/312:34:013
25473392123,5sleep30-21swapper/312:04:043
25345572122,6sleep30-21swapper/311:49:113
25221312122,6sleep30-21swapper/311:39:053
25005062122,6sleep30-21swapper/311:14:453
24815232122,6sleep30-21swapper/310:59:003
24704492122,6sleep30-21swapper/310:44:153
24568412122,6sleep30-21swapper/310:34:003
24509302122,5sleep30-21swapper/310:25:013
24272262122,6sleep30-21swapper/310:03:593
24223792122,6sleep30-21swapper/309:59:013
23773702122,6sleep30-21swapper/309:13:553
23740012122,6sleep30-21swapper/309:09:023
23635052122,6sleep30-21swapper/308:59:033
23573962122,6sleep30-21swapper/308:53:583
23470372122,5sleep30-21swapper/308:40:013
23470372122,5sleep30-21swapper/308:40:013
23380572122,6sleep30-21swapper/308:33:593
23077852122,6sleep30-21swapper/308:01:133
23035852122,6sleep30-21swapper/307:59:003
22932462122,6sleep30-21swapper/307:48:573
22866162122,6sleep30-21swapper/307:39:033
22782262122,6sleep30-21swapper/307:33:563
22770232122,6sleep30-21swapper/307:29:073
22684852122,6sleep30-21swapper/307:23:573
25657652112,6sleep30-21swapper/312:25:273
25605972112,5sleep30-21swapper/312:20:013
25565912112,5sleep30-21swapper/312:19:013
25512512112,5sleep30-21swapper/312:13:553
25512512112,5sleep30-21swapper/312:13:553
25355852113,5sleep30-21swapper/311:53:333
25256062112,5sleep30-21swapper/311:41:493
25197142112,5sleep30-21swapper/311:34:073
25108062112,5sleep30-21swapper/311:27:133
25008612113,5sleep30-21swapper/311:16:133
24915172112,5sleep30-21swapper/311:09:003
24860182113,5sleep30-21swapper/311:02:373
24712052112,5sleep30-21swapper/310:48:573
24615602112,5sleep30-21swapper/310:38:583
24364102112,6sleep30-21swapper/310:10:453
24157712112,5sleep30-21swapper/309:49:063
24018562112,5sleep30-21swapper/309:37:393
23975192112,5sleep30-21swapper/309:34:023
23866832112,5sleep30-21swapper/309:20:013
23825182112,5sleep30-21swapper/309:18:573
23522572112,6sleep30-21swapper/308:46:033
23425012112,5sleep30-21swapper/308:37:123
23238982112,5sleep30-21swapper/308:19:023
23180172112,5sleep30-21swapper/308:13:133
23131902112,5sleep30-21swapper/308:08:553
22921882112,5sleep30-21swapper/307:44:123
22672582112,5sleep30-21swapper/307:19:123
22558112112,5sleep30-21swapper/307:10:013
25501012102,5sleep30-21swapper/312:05:243
23275982102,5sleep30-21swapper/308:20:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional