You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-21 - 02:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Tue Apr 21, 2026 00:43:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2679299996049,6cyclictest0-21swapper/223:40:462
2679297996042,15cyclictest421-21dbus-daemon22:30:400
2679298995948,7cyclictest2825662-21ssh23:25:441
2679298995340,9cyclictest421-21dbus-daemon00:08:061
2679297995228,20cyclictest2733059-21xargs21:30:530
2679297995228,20cyclictest2733059-21xargs21:30:530
2679298995140,7cyclictest856456-21cups-browsed22:41:301
2679297995145,3cyclictest1-21systemd21:50:010
2679297994924,22cyclictest0-21swapper/022:00:010
2679299994842,3cyclictest0-21swapper/221:20:012
2679298994839,4cyclictest0-21swapper/123:55:391
2679298994839,4cyclictest0-21swapper/123:55:391
2679298994837,7cyclictest261-21systemd-journal21:18:341
2679298994837,5cyclictest0-21swapper/119:20:381
2679298994837,5cyclictest0-21swapper/119:20:381
2679297994826,19cyclictest420-21avahi-daemon22:25:520
2679297994725,19cyclictest2825425-21missed_timers23:25:370
2679297994722,4cyclictest421-21dbus-daemon23:00:020
2679297994722,4cyclictest421-21dbus-daemon23:00:020
267929799471,15cyclictest2761110-21ntpq22:05:450
2679299994632,10cyclictest2817810-21mailstats23:15:512
2679298994637,6cyclictest2779974-21ssh22:30:011
267929799465,37cyclictest2881642-21ssh00:35:430
267929799465,16cyclictest428-21mta-sts-daemon23:45:470
267929799464,36cyclictest2877617-21ssh00:30:420
267929799464,36cyclictest2877617-21ssh00:30:420
2679297994627,17cyclictest2805020-21idleruntime23:00:330
267929799462,18cyclictest2849730-21ssh23:55:420
267929799462,18cyclictest2849730-21ssh23:55:420
2679299994535,6cyclictest2828866-21aten_r2power_cu23:30:302
2679298994536,5cyclictest2876364-21cron00:30:011
2679297994537,5cyclictest1-21systemd00:30:020
2679297994523,17cyclictest12350irq/32-eth022:50:430
267929999444,34cyclictest2748980-21ssh21:50:452
2679298994435,6cyclictest1-21systemd20:20:011
2679297994421,4cyclictest2816342-21latency_hist23:15:030
2679298994336,4cyclictest2759802-21sh22:05:011
2679298994335,5cyclictest2792887-21ssh22:45:321
2679298994334,6cyclictest2686845-21systemd-run19:35:011
2679298994333,7cyclictest420-21avahi-daemon22:59:401
2679298994333,7cyclictest420-21avahi-daemon22:59:401
2679298994330,5cyclictest1051-21mta-sts-daemon21:45:411
2679297994321,3cyclictest2853208-21cpu00:00:310
2679297994321,19cyclictest0-21swapper/022:10:410
2679297994317,23cyclictest2780708-21kworker/u8:9+rpciod22:35:440
2679297994316,4cyclictest0-21swapper/021:10:350
267929799431,17cyclictest2737197-21unixbench-2d21:35:510
267929799431,16cyclictest2757032-21ssh22:00:430
2679298994233,6cyclictest439-21systemd-logind22:15:021
2679298994231,7cyclictest2861967-21proc_pri00:10:481
2679297994220,3cyclictest0-21swapper/000:10:010
2679297994218,21cyclictest2817373-21missed_timers23:15:380
267929799421,18cyclictest2789389-21ssh22:40:480
2679299994134,4cyclictest2759829-21ssh22:05:012
267929999413,31cyclictest2781274-21ssh22:30:442
267929999413,31cyclictest2716577-21ssh21:10:412
2679298994134,3cyclictest0-21swapper/100:30:361
2679298994134,3cyclictest0-21swapper/100:30:361
2679297994134,4cyclictest2696004-21latency_hist20:05:020
267929799413,10cyclictest2724837-21ssh21:20:510
267929799412,15cyclictest2836928-21cut23:40:300
2679299994033,4cyclictest2694315-21munin-run20:00:012
2679299994032,4cyclictest2700359-21kworker/u8:4-rpciod21:35:002
2679299994032,4cyclictest2700359-21kworker/u8:4-rpciod21:35:002
2679299994030,8cyclictest1-21systemd00:10:012
267929899403,28cyclictest2740762-21ssh21:40:411
2679298994031,6cyclictest2715357-21systemd-run21:10:011
2679298994031,4cyclictest0-21swapper/123:40:011
2679298994029,8cyclictest2797894-21unixbench_multi22:50:521
267929799403,8cyclictest2748881-21ntpq21:50:410
2679297994030,8cyclictest2723443-21cron21:20:010
267929799402,16cyclictest2773126-21/usr/sbin/munin22:20:420
2679299993932,3cyclictest0-21swapper/222:40:012
2679299993931,5cyclictest2824402-21ssh23:25:022
2679298993933,3cyclictest0-21swapper/122:15:501
2679298993929,7cyclictest2868428-21idleruntime-cro00:20:011
2679297993925,11cyclictest2771860-21cron22:20:000
267929799392,16cyclictest2809524-21ssh23:05:420
2679299993834,2cyclictest0-21swapper/223:55:012
2679299993828,7cyclictest0-21swapper/223:25:522
2679298993832,4cyclictest2679296-21cyclictest20:05:451
2679298993832,3cyclictest0-21swapper/121:40:001
2679298993831,4cyclictest0-21swapper/100:20:451
2679298993830,5cyclictest2729195-21unixbench-2d21:25:531
2679298993826,5cyclictest2809395-21ntp_kernel_err23:05:381
2679297993817,3cyclictest0-21swapper/022:46:060
2679299993730,4cyclictest2755763-21tr22:00:012
2679299993730,4cyclictest2695831-21cron20:05:012
2679299993723,9cyclictest2715327-21diskmemload21:45:392
267929999372,28cyclictest2761100-21ssh22:05:452
2679298993729,5cyclictest2814043-21unixbench-2d23:10:521
2679298993729,5cyclictest2689857-21systemd-run19:45:011
2679298993729,5cyclictest2685408-21latency_hist19:30:011
267929899372,23cyclictest2716609-21ssh21:10:421
267929899371,29cyclictest2785236-21ssh22:35:451
2679297993728,6cyclictest421-21dbus-daemon00:14:000
267929799372,17cyclictest2728648-21ssh21:25:410
2679297993716,3cyclictest1054-21mta-sts-daemon20:52:190
267929799371,15cyclictest2707355-21ps20:40:450
2679299993629,4cyclictest2804695-21aten_r2power_cu23:00:292
2679299993629,3cyclictest0-21swapper/222:25:322
2679299993628,5cyclictest2764433-21aten_r2power_po22:10:302
2679299993628,4cyclictest0-21swapper/221:20:472
2679299993625,8cyclictest1051-21mta-sts-daemon00:20:552
267929999362,26cyclictest2873681-21ssh00:25:462
2679298993630,3cyclictest0-21swapper/121:50:401
2679298993623,9cyclictest2752915-21ntpq21:55:411
2679297993629,4cyclictest1970215-21kworker/u8:3+xprtiod19:50:020
2679297993628,5cyclictest151ktimers/020:15:410
2679299993529,3cyclictest0-21swapper/220:20:002
2679299993524,8cyclictest2884375-21sh00:40:012
2679298993528,4cyclictest1051-21mta-sts-daemon23:20:431
2679298993527,5cyclictest856456-21cups-browsed22:05:541
2679298993527,5cyclictest2845052-21aten_r2power_vo23:50:321
2679298993527,5cyclictest2715327-21diskmemload00:35:301
2679298993527,3cyclictest0-21swapper/121:30:431
2679298993527,3cyclictest0-21swapper/121:30:431
267929899352,26cyclictest2817647-21ssh23:15:471
267929799354,9cyclictest2865748-21ntpq00:15:370
2679297993530,3cyclictest2836445-21sendmail23:40:010
2679297993525,7cyclictest0-21swapper/023:20:430
2679299993425,5cyclictest2864756-21latency_hist00:15:022
2679299993425,3cyclictest0-21swapper/222:55:492
2679299993425,3cyclictest0-21swapper/222:55:492
2679299993413,4cyclictest36-21ksoftirqd/220:30:432
2679298993426,5cyclictest2841421-21missed_timers23:45:401
2679298993426,5cyclictest0-21swapper/100:04:491
2679298993425,6cyclictest421-21dbus-daemon20:55:011
2679298993425,5cyclictest2691846-21fschecks_count19:50:351
2679297993424,8cyclictest2680094-21needreboot19:10:370
267929799341,28cyclictest2869714-21ssh00:20:440
267929999339,4cyclictest36-21ksoftirqd/223:40:012
267929999339,4cyclictest36-21ksoftirqd/200:15:422
2679299993326,4cyclictest2712313-21munin-run21:00:012
2679299993326,3cyclictest0-21swapper/221:40:002
2679299993324,6cyclictest261-21systemd-journal20:15:002
2679299993314,5cyclictest36-21ksoftirqd/221:40:412
2679299993312,5cyclictest36-21ksoftirqd/220:35:402
2679299993312,4cyclictest36-21ksoftirqd/220:45:452
2679299993310,4cyclictest36-21ksoftirqd/219:20:402
2679299993310,4cyclictest36-21ksoftirqd/219:20:402
267929899333,25cyclictest2781255-21ssh22:30:431
2679298993326,4cyclictest2694307-21cron20:00:011
2679298993325,5cyclictest1-21systemd23:05:011
2679297993327,4cyclictest2762800-21kworker/u8:0-xprtiod23:50:420
2679297993310,18cyclictest2740698-21diskmemload21:40:390
2679299993227,2cyclictest0-21swapper/220:45:012
2679299993224,5cyclictest421-21dbus-daemon21:05:012
2679299993224,5cyclictest2878161-21grep00:30:522
2679299993224,5cyclictest2878161-21grep00:30:522
2679299993222,6cyclictest0-21swapper/223:05:302
2679299993220,9cyclictest2768854-21latency22:15:392
267929999321,26cyclictest2813490-21ssh23:10:412
2679299993211,4cyclictest36-21ksoftirqd/219:30:422
2679299993210,5cyclictest36-21ksoftirqd/223:45:492
2679299993210,5cyclictest36-21ksoftirqd/200:00:412
2679298993225,3cyclictest0-21swapper/121:00:011
2679298993224,5cyclictest0-21swapper/121:24:361
2679297993225,5cyclictest2712353-21systemd-run21:00:010
267929799322,24cyclictest856456-21cups-browsed19:40:480
2679297993222,4cyclictest2829997-21timerandwakeup23:30:510
2679297993217,12cyclictest0-21swapper/020:00:010
2679299993124,3cyclictest0-21swapper/222:50:022
2679299993110,5cyclictest36-21ksoftirqd/223:55:402
2679299993110,5cyclictest36-21ksoftirqd/223:55:402
267929899317,19cyclictest2837693-21ssh23:40:471
2679298993124,3cyclictest0-21swapper/122:20:401
2679298993124,3cyclictest0-21swapper/119:20:011
2679298993123,4cyclictest0-21swapper/123:30:391
2679298993122,6cyclictest2700857-21fschecks_count20:20:331
2679298993122,6cyclictest2700857-21fschecks_count20:20:331
2679297993124,4cyclictest0-21swapper/020:40:010
2679297993122,3cyclictest0-21swapper/019:25:450
2679297993119,4cyclictest2713824-21cron21:05:010
267929999309,4cyclictest36-21ksoftirqd/222:50:392
267929999307,5cyclictest36-21ksoftirqd/222:40:422
2679299993023,4cyclictest2696478-21kernelversion20:05:352
2679299993021,4cyclictest0-21swapper/221:25:312
2679299993011,5cyclictest36-21ksoftirqd/219:50:462
2679299993010,6cyclictest36-21ksoftirqd/222:20:432
2679298993025,2cyclictest0-21swapper/120:05:011
2679298993024,3cyclictest0-21swapper/120:40:011
2679297993024,3cyclictest0-21swapper/019:35:400
2679297993022,4cyclictest2704895-21latency_hist20:35:020
267929999298,5cyclictest36-21ksoftirqd/219:15:372
2679298992922,4cyclictest2694297-21kworker/u8:6-xprtiod20:45:321
2679298992921,5cyclictest2698717-21unixbench_multi20:10:511
2679297992915,11cyclictest0-21swapper/020:45:360
267929999289,4cyclictest36-21ksoftirqd/219:45:442
267929999289,4cyclictest36-21ksoftirqd/219:10:402
267929999288,5cyclictest36-21ksoftirqd/219:35:382
2679299992820,5cyclictest2715210-21unixbench_multi21:05:512
2679299992812,5cyclictest36-21ksoftirqd/220:25:382
2679298992820,5cyclictest2704750-21unixbench_singl20:30:541
2679297992822,3cyclictest151ktimers/019:20:430
2679297992822,3cyclictest151ktimers/019:20:430
2679297992818,7cyclictest2714697-21ntp_kernel_pll_21:05:390
267929999278,5cyclictest36-21ksoftirqd/219:40:482
267929999278,4cyclictest36-21ksoftirqd/220:50:362
267929999276,4cyclictest36-21ksoftirqd/219:25:462
2679298992720,4cyclictest695-21cron20:45:011
2679298992719,5cyclictest2687144-21aten_r2power_fr19:35:301
2679298992718,6cyclictest2679817-21fschecks_time19:10:331
2679297992720,5cyclictest420-21avahi-daemon19:50:320
2679297992720,5cyclictest0-21swapper/020:25:000
2679297992720,5cyclictest0-21swapper/020:25:000
2679297992712,11cyclictest421-21dbus-daemon19:35:020
267929999268,4cyclictest36-21ksoftirqd/219:10:012
267929999267,13cyclictest36-21ksoftirqd/220:24:492
267929999267,13cyclictest36-21ksoftirqd/220:24:492
2679297992418,4cyclictest2696173-21aten2.4-expect20:05:310
2679297992417,5cyclictest421-21dbus-daemon20:25:330
267929899232,16cyclictest2690733-21ntpq19:45:431
2679298992314,6cyclictest2703346-21true20:30:011
2679297992317,4cyclictest1055-21mta-sts-daemon20:10:370
2679297992310,10cyclictest0-21swapper/019:15:350
267929899221,15cyclictest2713254-21ntpq21:00:411
2679298991913,3cyclictest0-21swapper/119:10:021
267930099183,9cyclictest0-21swapper/321:45:423
2679297991812,4cyclictest2679308-21systemd-run19:10:010
267930099161,8cyclictest0-21swapper/323:00:433
267930099161,6cyclictest0-21swapper/322:15:423
267930099153,7cyclictest0-21swapper/323:55:393
267930099153,7cyclictest0-21swapper/323:55:393
267930099152,7cyclictest0-21swapper/323:05:383
267930099152,7cyclictest0-21swapper/321:55:443
267930099152,6cyclictest0-21swapper/300:05:423
267930099152,5cyclictest0-21swapper/320:55:393
267930099151,8cyclictest0-21swapper/322:55:403
267930099151,8cyclictest0-21swapper/322:55:403
267930099151,8cyclictest0-21swapper/321:10:443
267930099151,8cyclictest0-21swapper/300:10:403
267930099151,7cyclictest0-21swapper/322:10:413
267930099151,7cyclictest0-21swapper/319:14:333
267930099151,6cyclictest0-21swapper/320:40:373
267930099142,7cyclictest0-21swapper/323:45:313
267930099142,7cyclictest0-21swapper/323:30:423
267930099142,7cyclictest0-21swapper/323:10:473
267930099142,7cyclictest0-21swapper/321:20:433
267930099142,7cyclictest0-21swapper/300:35:033
267930099142,7cyclictest0-21swapper/300:35:033
267930099141,9cyclictest0-21swapper/322:05:463
267930099141,8cyclictest0-21swapper/323:15:483
267930099141,7cyclictest0-21swapper/300:15:403
267930099141,6cyclictest0-21swapper/320:20:433
267930099141,6cyclictest0-21swapper/320:20:433
267930099135,5cyclictest0-21swapper/321:15:413
267930099134,6cyclictest0-21swapper/323:35:383
267930099133,6cyclictest0-21swapper/323:25:443
267930099133,6cyclictest0-21swapper/322:20:393
267930099132,7cyclictest0-21swapper/321:50:303
267930099132,7cyclictest0-21swapper/321:25:423
267930099132,7cyclictest0-21swapper/300:25:453
267930099132,6cyclictest0-21swapper/322:50:323
267930099132,6cyclictest0-21swapper/322:30:413
267930099132,6cyclictest0-21swapper/300:00:393
267930099132,5cyclictest0-21swapper/319:20:383
267930099132,5cyclictest0-21swapper/319:20:383
267930099131,7cyclictest0-21swapper/323:50:423
267930099131,7cyclictest0-21swapper/323:40:443
267930099131,7cyclictest0-21swapper/322:35:453
267930099131,7cyclictest0-21swapper/321:40:463
267930099131,7cyclictest0-21swapper/321:35:393
267930099131,7cyclictest0-21swapper/319:25:383
267930099131,6cyclictest0-21swapper/321:00:373
267930099131,6cyclictest0-21swapper/320:35:393
267930099131,5cyclictest0-21swapper/319:40:473
267930099122,6cyclictest0-21swapper/319:40:013
267930099122,6cyclictest0-21swapper/300:20:403
267930099121,8cyclictest0-21swapper/323:20:313
267930099121,7cyclictest0-21swapper/322:40:413
267930099121,7cyclictest0-21swapper/322:00:343
267930099121,7cyclictest0-21swapper/321:30:323
267930099121,7cyclictest0-21swapper/321:30:323
267930099121,6cyclictest0-21swapper/322:45:103
267930099121,6cyclictest0-21swapper/320:30:323
267930099121,6cyclictest0-21swapper/319:55:413
267930099121,5cyclictest0-21swapper/320:05:413
267930099112,5cyclictest0-21swapper/320:50:403
267930099111,7cyclictest0-21swapper/322:25:313
267930099111,6cyclictest0-21swapper/320:25:373
267930099111,5cyclictest0-21swapper/320:45:423
267930099111,5cyclictest0-21swapper/319:30:393
267930099111,3cyclictest0-21swapper/300:35:043
267930099104,4cyclictest0-21swapper/319:15:423
267930099101,5cyclictest0-21swapper/321:10:023
267930099101,5cyclictest0-21swapper/320:15:293
267930099101,5cyclictest0-21swapper/320:00:403
267930099101,5cyclictest0-21swapper/319:45:323
26793009991,4cyclictest0-21swapper/320:10:293
26793009990,5cyclictest0-21swapper/319:55:023
26793009982,4cyclictest0-21swapper/319:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional