You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-12 - 09:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Sun Jul 12, 2026 00:43:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4144362995741,3cyclictest171rcu_preempt23:30:442
4144362995446,5cyclictest4174359-21systemd-run20:50:012
414436099532,45cyclictest151ktimers/022:35:400
4144362994738,6cyclictest53601-21kworker/u8:10-xprtiod23:25:012
4144362994738,6cyclictest47281-21munin-run22:50:012
4144362994637,6cyclictest101904-21ssh00:20:012
4144362994636,5cyclictest1003-21mta-sts-daemon23:50:432
4144362994624,5cyclictest171rcu_preempt23:35:412
414436199467,28cyclictest17961-21ssh22:00:391
4144362994535,6cyclictest4180346-21idleruntime-cro21:10:012
4144362994534,7cyclictest0-21swapper/223:45:392
4144361994536,6cyclictest4171368-21systemd-run20:40:011
4144360994534,5cyclictest12750irq/33-eth020:45:440
4144362994432,8cyclictest2395397-21cups-browsed20:25:472
4144361994435,5cyclictest1000-21mta-sts-daemon22:55:451
4144360994429,10cyclictest151ktimers/020:00:410
4144362994328,11cyclictest4187508-21awk21:20:392
4144362994326,11cyclictest1-21systemd21:35:022
4144361994335,4cyclictest1000-21mta-sts-daemon23:14:011
414436099425,28cyclictest90964-21sh00:00:440
4144362994133,5cyclictest13894-21latency_hist21:55:022
4144362994129,7cyclictest2395397-21cups-browsed21:45:482
4144360994132,6cyclictest0-21swapper/023:00:010
4144362994021,14cyclictest351ktimers/220:15:382
4144361994034,3cyclictest0-21swapper/100:20:011
4144361994033,4cyclictest4151868-21systemd-run19:35:011
4144361994032,5cyclictest68537-21grep23:25:001
4144361994032,5cyclictest4172846-21munin-plugin-st20:45:011
4144361994031,6cyclictest1002-21mta-sts-daemon22:41:591
4144361994030,7cyclictest421-21dbus-daemon21:20:411
4144360994030,5cyclictest0-21swapper/022:30:450
4144360994018,18cyclictest151ktimers/021:10:460
414436299394,29cyclictest48441-21ssh22:50:432
4144362993930,5cyclictest4183538-21latency_hist21:15:022
4144362993930,5cyclictest4161360-21fschecks_count20:05:352
4144362993930,4cyclictest0-21swapper/222:30:012
4144362993929,7cyclictest59433-21systemd-run23:10:012
4144362993926,10cyclictest35927-21kernelversion22:30:342
4144361993928,4cyclictest1002-21mta-sts-daemon22:10:031
4144360993932,4cyclictest81981-21mailstats23:45:480
4144360993932,4cyclictest4156366-21systemd-run19:50:010
4144360993932,4cyclictest4156366-21systemd-run19:50:010
4144360993930,5cyclictest420-21avahi-daemon22:50:230
4144362993830,5cyclictest1002-21mta-sts-daemon23:58:342
4144362993829,6cyclictest95875-21munin-run00:10:012
4144362993829,6cyclictest265-21systemd-journal22:00:012
414436199384,28cyclictest75753-21sh23:35:441
4144361993831,4cyclictest16882-21latency_hist22:00:011
4144361993830,5cyclictest30317-21proc_pri22:20:471
4144361993830,5cyclictest29045-21munin-run22:20:011
4144361993829,5cyclictest4149555-21latency19:25:371
4144361993827,8cyclictest11813-21needreboot21:50:371
4144362993728,6cyclictest71572-21rm23:30:012
4144362993727,7cyclictest694-21cron20:15:012
4144362993727,6cyclictest106366-21switchtime00:25:502
4144361993731,2cyclictest0-21swapper/100:35:011
4144361993728,6cyclictest1-21systemd23:45:021
4144360993731,4cyclictest4163801-21kworker/u8:5-xprtiod21:00:010
4144360993727,7cyclictest4149664-21needreboot19:25:380
4144360993725,9cyclictest61100-21grep23:10:510
4144360993723,8cyclictest70186-21unixbench_multi23:25:520
4144360993720,14cyclictest421-21dbus-daemon22:02:290
4144362993628,5cyclictest26004-21cron22:15:002
4144362993627,6cyclictest420-21avahi-daemon22:20:512
4144362993626,6cyclictest7951-21latency_hist21:45:032
4144362993626,4cyclictest0-21swapper/222:55:432
4144362993625,5cyclictest0-21swapper/221:15:422
4144361993630,3cyclictest0-21swapper/120:20:021
4144361993627,6cyclictest4154867-21systemd-run19:45:011
4144361993627,6cyclictest4145834-21cron19:15:011
4144361993627,3cyclictest0-21swapper/120:30:441
4144361993625,4cyclictest0-21swapper/100:10:471
4144360993624,9cyclictest4192595-21munin-run21:30:020
4144360993623,10cyclictest1000-21mta-sts-daemon21:35:410
414436099360,28cyclictest11954-21ssh21:50:420
4144362993528,5cyclictest4144359-21cyclictest19:30:412
4144362993527,5cyclictest4176922-21mailstats20:55:502
4144362993527,4cyclictest1001-21mta-sts-daemon23:15:122
4144362993525,3cyclictest0-21swapper/222:35:512
4144361993528,4cyclictest1003-21mta-sts-daemon20:10:381
4144361993527,5cyclictest56383-21cron23:05:011
4144361993527,4cyclictest1002-21mta-sts-daemon23:19:181
4144361993526,5cyclictest89824-21cups-browsed00:00:031
4144361993525,7cyclictest665-21snmpd21:00:381
4144361993525,4cyclictest0-21swapper/123:45:401
4144360993530,3cyclictest0-21swapper/019:20:010
4144360993527,5cyclictest4175824-21sh20:55:010
4144360993526,6cyclictest2494265-21munin-node00:15:270
4144360993512,17cyclictest12650irq/32-eth023:55:400
4144362993426,5cyclictest2952-21systemctl21:35:462
4144362993426,5cyclictest23020-21latency_hist22:10:012
4144362993426,5cyclictest23020-21latency_hist22:10:012
4144362993422,9cyclictest60817-21switchtime23:10:492
4144361993427,5cyclictest108025-21systemd-run00:30:021
4144361993427,4cyclictest1000-21mta-sts-daemon23:34:531
4144361993426,5cyclictest439-21systemd-logind21:50:011
4144361993426,5cyclictest114062-21ssh00:40:011
4144361993422,9cyclictest4175834-21munin-plugin-st20:55:011
414436099342,5cyclictest8817-21ssh21:45:380
4144360993425,6cyclictest89824-21cups-browsed00:20:440
4144360993421,10cyclictest0-21swapper/020:30:010
414436299335,18cyclictest428-21mta-sts-daemon00:35:472
4144362993325,5cyclictest2395397-21cups-browsed19:35:322
4144362993324,7cyclictest0-21swapper/220:05:002
4144362993322,6cyclictest0-21swapper/200:10:152
4144362993321,9cyclictest4155656-21needreboot19:45:362
4144362993321,9cyclictest4155656-21needreboot19:45:362
4144362993312,12cyclictest351ktimers/220:40:382
4144361993326,4cyclictest5709-21needreboot21:40:351
4144361993322,8cyclictest38962-21sh22:35:351
4144361993322,5cyclictest271ktimers/122:50:401
4144360993325,5cyclictest66274-21if_wlan023:20:330
4144360993325,5cyclictest32648-21aten_r2power_vo22:25:320
4144362993226,3cyclictest0-21swapper/200:25:012
4144362993222,4cyclictest0-21swapper/200:00:452
414436299322,23cyclictest109125-21ssh00:30:422
4144361993226,3cyclictest0-21swapper/100:05:021
4144361993224,5cyclictest2395397-21cups-browsed21:28:121
4144360993226,4cyclictest4180331-21cron21:10:010
4144360993226,4cyclictest41761-21aten_r2power_vo22:40:300
4144360993226,3cyclictest1002-21mta-sts-daemon00:10:410
4144360993224,5cyclictest112729-21unixbench_singl00:35:530
4144360993222,7cyclictest94313-21timerandwakeup00:05:500
4144360993221,4cyclictest1003-21mta-sts-daemon00:25:400
4144360993219,10cyclictest0-21swapper/023:35:530
4144362993124,4cyclictest78512-21latency23:40:342
4144362993124,4cyclictest4148289-21ntp_offset19:20:432
4144362993114,3cyclictest171rcu_preempt20:35:422
414436299311,23cyclictest17946-21ssh22:00:392
414436199313,21cyclictest566-21gmain19:35:391
4144361993125,4cyclictest1001-21mta-sts-daemon21:15:151
4144361993125,3cyclictest0-21swapper/123:50:321
4144361993124,4cyclictest71641-21latency_hist23:30:021
4144361993124,3cyclictest0-21swapper/123:05:311
4144361993123,4cyclictest0-21swapper/121:35:391
4144361993120,8cyclictest4159365-21sh20:00:011
4144360993125,4cyclictest47275-21idleruntime-cro22:50:010
4144360993124,4cyclictest111045-21munin-plugin-st00:35:010
4144360993123,5cyclictest420-21avahi-daemon21:17:340
4144360993123,5cyclictest4186957-21/usr/sbin/munin21:20:300
414436299308,6cyclictest171rcu_preempt20:50:422
4144362993026,2cyclictest0-21swapper/219:20:012
414436299302,22cyclictest420-21avahi-daemon19:40:412
4144361993023,4cyclictest33745-21unixbench_multi22:25:551
4144361993022,5cyclictest441-21thd21:31:291
4144361993022,4cyclictest4165721-21aten_r2power_po20:20:301
4144361993021,5cyclictest4180825-21aten_r2power_fr21:10:291
4144360993025,3cyclictest0-21swapper/019:45:010
4144360993024,3cyclictest0-21swapper/022:05:360
4144360993024,3cyclictest0-21swapper/022:05:360
4144360993023,4cyclictest151ktimers/022:10:440
414436299294,14cyclictest42330-21ssh22:40:422
4144362992920,4cyclictest0-21swapper/221:25:452
4144361992923,3cyclictest0-21swapper/120:50:011
4144361992921,3cyclictest0-21swapper/100:20:441
414436099293,21cyclictest63577-21ssh23:15:430
4144360992924,2cyclictest0-21swapper/022:20:010
4144360992922,4cyclictest4165212-21tail20:15:490
4144360992922,3cyclictest0-21swapper/021:44:580
4144360992922,3cyclictest0-21swapper/021:30:330
4144362992821,4cyclictest4145862-21kworker/u8:1-xprtiod19:25:372
4144362992818,5cyclictest0-21swapper/222:15:112
4144361992822,3cyclictest0-21swapper/122:05:281
4144361992822,3cyclictest0-21swapper/122:05:281
4144361992821,4cyclictest36801-21unixbench_singl22:30:511
414436099283,18cyclictest428-21mta-sts-daemon19:30:450
4144360992822,3cyclictest0-21swapper/023:40:290
4144360992820,5cyclictest4165886-21fschecks_time20:20:330
4144360992819,6cyclictest2395397-21cups-browsed21:55:310
4144360992819,5cyclictest0-21swapper/023:50:330
414436299275,19cyclictest54550-21ntp_states23:00:462
414436299273,16cyclictest2395397-21cups-browsed19:10:432
4144362992714,7cyclictest2395397-21cups-browsed21:00:392
4144362992711,12cyclictest351ktimers/219:55:452
4144361992720,4cyclictest1000-21mta-sts-daemon20:58:051
4144361992720,3cyclictest0-21swapper/122:50:011
4144361992718,7cyclictest4161375-21fschecks_time20:05:351
4144360992722,3cyclictest4767-21kworker/u8:11-xprtiod22:25:010
4144360992721,4cyclictest59419-21munin-plugin-st23:10:010
4144360992720,4cyclictest73427-21ssh23:31:210
4144360992717,5cyclictest12750irq/33-eth019:55:340
4144362992616,7cyclictest1001-21mta-sts-daemon19:50:392
4144361992620,3cyclictest0-21swapper/100:05:421
4144360992621,3cyclictest0-21swapper/019:25:010
4144360992621,2cyclictest0-21swapper/019:55:010
4144360992620,4cyclictest4162229-21unixbench_multi20:05:540
4144362992519,3cyclictest0-21swapper/220:25:012
414436199253,12cyclictest428-21mta-sts-daemon20:25:411
4144361992519,3cyclictest0-21swapper/119:25:011
4144361992518,3cyclictest0-21swapper/119:20:021
4144361992517,5cyclictest2395397-21cups-browsed19:45:271
4144361992517,5cyclictest2395397-21cups-browsed19:45:271
4144360992520,2cyclictest0-21swapper/019:40:010
4144360992519,3cyclictest0-21swapper/019:10:430
4144360992517,6cyclictest4171133-21timerwakeupswit20:35:510
4144362992416,5cyclictest4168869-21fschecks_time20:30:322
4144361992415,6cyclictest2395397-21cups-browsed21:09:381
414436099243,11cyclictest4180336-21diskmemload23:00:140
4144360992416,4cyclictest12750irq/33-eth020:30:410
4144360992317,3cyclictest0-21swapper/021:05:010
4144361992213,6cyclictest4160397-21ps20:00:471
414436099222,15cyclictest4172273-21ntpq20:40:420
414436099221,18cyclictest2395397-21cups-browsed20:13:300
4144361992114,4cyclictest4156989-21kernelversion19:50:351
4144362992013,5cyclictest4144404-21latency_hist19:10:022
4144360991910,6cyclictest567-21gdbus19:10:010
414436399172,7cyclictest0-21swapper/322:30:453
414436399172,7cyclictest0-21swapper/322:10:453
414436399171,9cyclictest0-21swapper/322:50:323
414436399171,8cyclictest0-21swapper/322:05:433
414436399171,8cyclictest0-21swapper/322:05:433
414436199174,9cyclictest421-21dbus-daemon19:10:011
414436399163,9cyclictest0-21swapper/322:35:403
414436399161,7cyclictest0-21swapper/320:00:463
414436399161,3cyclictest0-21swapper/321:25:393
414436399161,10cyclictest0-21swapper/320:55:463
414436399153,5cyclictest0-21swapper/319:15:403
414436399152,7cyclictest0-21swapper/322:25:503
414436399152,5cyclictest0-21swapper/320:10:373
414436399151,8cyclictest0-21swapper/323:20:313
414436399144,6cyclictest0-21swapper/323:00:503
414436399142,8cyclictest0-21swapper/300:35:453
414436399142,7cyclictest0-21swapper/323:25:393
414436399142,7cyclictest0-21swapper/321:55:373
414436399142,7cyclictest0-21swapper/320:05:483
414436399142,7cyclictest0-21swapper/300:20:413
414436399142,7cyclictest0-21swapper/300:15:433
414436399142,6cyclictest0-21swapper/321:45:413
414436399142,6cyclictest0-21swapper/320:15:403
414436399142,5cyclictest0-21swapper/323:35:313
414436399141,7cyclictest0-21swapper/321:10:443
414436399141,7cyclictest0-21swapper/319:20:413
414436399141,6cyclictest0-21swapper/322:45:313
414436399141,6cyclictest0-21swapper/319:35:413
414436399133,5cyclictest0-21swapper/320:00:003
414436399132,7cyclictest0-21swapper/323:45:333
414436399132,7cyclictest0-21swapper/323:40:283
414436399132,7cyclictest0-21swapper/300:35:033
414436399132,6cyclictest0-21swapper/323:05:363
414436399131,8cyclictest0-21swapper/322:00:593
414436399131,7cyclictest0-21swapper/322:40:303
414436399131,7cyclictest0-21swapper/322:15:373
414436399131,7cyclictest0-21swapper/321:50:413
414436399131,7cyclictest0-21swapper/321:35:393
414436399131,7cyclictest0-21swapper/321:20:323
414436399131,7cyclictest0-21swapper/300:25:463
414436399131,6cyclictest0-21swapper/320:35:413
414436399131,6cyclictest0-21swapper/319:50:413
414436399131,6cyclictest0-21swapper/300:05:353
414436399131,5cyclictest0-21swapper/320:30:383
414436399130,6cyclictest0-21swapper/320:25:423
414436399122,7cyclictest0-21swapper/322:55:403
414436399122,7cyclictest0-21swapper/321:40:393
414436399122,6cyclictest0-21swapper/300:10:503
414436399122,4cyclictest0-21swapper/320:20:393
414436399121,8cyclictest0-21swapper/323:10:283
414436399121,7cyclictest0-21swapper/323:55:313
414436399121,7cyclictest0-21swapper/323:50:353
414436399121,7cyclictest0-21swapper/300:00:423
414436399121,6cyclictest0-21swapper/323:20:023
414436399121,6cyclictest0-21swapper/319:45:323
414436399121,6cyclictest0-21swapper/319:45:323
414436399121,6cyclictest0-21swapper/319:40:383
414436399121,5cyclictest0-21swapper/321:05:413
414436399121,5cyclictest0-21swapper/321:00:383
414436399111,6cyclictest0-21swapper/323:30:313
414436399111,5cyclictest0-21swapper/321:35:023
414436399111,5cyclictest0-21swapper/320:45:373
414436399111,5cyclictest0-21swapper/320:40:303
414436399111,5cyclictest0-21swapper/319:25:413
414436399111,5cyclictest0-21swapper/319:10:423
414436399103,5cyclictest0-21swapper/322:20:323
414436399102,6cyclictest0-21swapper/319:10:013
414436399101,6cyclictest0-21swapper/321:15:373
414436399101,5cyclictest0-21swapper/319:35:023
414436399101,4cyclictest0-21swapper/320:50:293
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional