You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-01 - 17:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack2slot7s.osadl.org (updated Mon Jun 01, 2026 12:42:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
436114995529,17cyclictest151ktimers/008:16:010
43611499531,44cyclictest151ktimers/009:46:070
436115995140,4cyclictest0-21swapper/109:16:041
436116995038,8cyclictest3835474-21cups-browsed11:16:562
436115995036,11cyclictest526816-21entropy10:35:551
436114994841,3cyclictest0-21swapper/010:25:010
43611699479,27cyclictest520950-21ssh10:26:052
43611599475,35cyclictest517888-21ssh10:21:111
43611699462,36cyclictest539904-21ssh10:56:002
436116994539,2cyclictest0-21swapper/210:09:022
436116994537,5cyclictest481605-21ssh09:25:012
43611499453,30cyclictest524080-21ssh10:31:030
436114994432,7cyclictest151ktimers/009:01:040
436116994233,6cyclictest461532-21unixbench_singl08:31:142
43611699421,31cyclictest501928-21ssh09:56:062
436114994235,4cyclictest541929-21systemd-run11:00:010
436115994132,6cyclictest526212-21latency_hist10:35:021
436115994132,6cyclictest493584-21sshd09:43:011
436114994135,4cyclictest564027-21systemd11:35:020
436114994127,11cyclictest451091-21munin-run08:00:010
436114994126,7cyclictest12350irq/32-eth010:41:010
43611699404,30cyclictest580927-21sshd12:01:022
436116994032,5cyclictest464608-21cut08:45:012
436116993933,3cyclictest0-21swapper/210:40:012
436114993931,5cyclictest421-21dbus-daemon10:30:010
436116993833,2cyclictest0-21swapper/207:40:012
436116993832,3cyclictest0-21swapper/208:00:012
436116993830,5cyclictest519673-21latency_hist10:25:012
436116993829,6cyclictest261-21systemd-journal07:55:012
436116993823,8cyclictest567126-21idleruntime-cro11:40:012
436115993833,3cyclictest0-21swapper/108:00:011
436115993831,4cyclictest510181-21kworker/u8:11+xprtiod10:10:011
436115993830,5cyclictest470623-21systemd-run09:05:011
436115993830,4cyclictest0-21swapper/111:36:031
436115993828,7cyclictest473763-21timerwakeupswit09:11:121
436114993832,3cyclictest0-21swapper/008:15:010
43611499382,23cyclictest1055-21mta-sts-daemon10:06:000
436116993731,3cyclictest0-21swapper/210:16:002
436116993729,3cyclictest0-21swapper/208:40:012
436116993728,6cyclictest548-21gdbus08:26:142
436116993728,4cyclictest0-21swapper/210:01:002
436116993727,7cyclictest447421-21needreboot07:46:022
436114993729,5cyclictest552258-21fschecks_time11:15:540
436114993729,3cyclictest0-21swapper/012:31:020
436114993728,6cyclictest534172-21grep10:46:120
436114993715,15cyclictest12350irq/32-eth011:51:000
436114993714,16cyclictest479651-21ntpq09:21:050
43611699364,28cyclictest587232-21ssh12:11:032
436116993629,3cyclictest0-21swapper/212:15:562
436116993624,8cyclictest3835474-21cups-browsed11:11:032
436115993629,3cyclictest0-21swapper/109:46:081
436115993628,5cyclictest604802-21idleruntime-cro12:40:011
436115993628,5cyclictest548286-21systemd-run11:10:011
436115993627,4cyclictest0-21swapper/111:31:031
43611699356,24cyclictest494321-21cat09:45:022
436116993528,4cyclictest1056-21mta-sts-daemon11:56:012
436116993527,5cyclictest546900-21grep11:06:132
436116993526,6cyclictest576529-21cron11:55:012
436115993527,5cyclictest541935-21systemd-run11:00:011
436115993526,6cyclictest599975-21mailstats12:31:091
43611599352,27cyclictest514604-21ssh10:16:031
43611599351,24cyclictest552618-21sh11:16:001
436116993426,4cyclictest0-21swapper/210:41:022
436115993428,3cyclictest1051-21mta-sts-daemon11:56:061
436115993427,4cyclictest440616-21idleruntime-cro07:25:001
436115993427,3cyclictest0-21swapper/112:26:021
436114993429,3cyclictest487984-21latency_hist09:35:020
436114993428,4cyclictest504621-21ssh10:00:540
436114993424,6cyclictest578266-21grep11:56:130
43611499342,26cyclictest476634-21ssh09:16:110
436114993421,9cyclictest567162-21kworker/u8:1+xprtiod12:01:060
43611699333,13cyclictest439519-21aten2.4-expect07:20:512
436116993328,3cyclictest529325-21kworker/u8:5-xprtiod10:51:042
436116993327,3cyclictest1055-21mta-sts-daemon08:20:002
436116993323,6cyclictest3835471-21cupsd09:27:092
43611699332,24cyclictest489122-21ssh09:36:022
436116993312,5cyclictest36-21ksoftirqd/208:06:092
436115993326,5cyclictest0-21swapper/107:35:021
436115993326,4cyclictest695-21cron09:55:001
436115993325,5cyclictest592230-21sendmail12:20:011
436115993325,5cyclictest452146-21processes08:01:071
436115993325,5cyclictest1-21systemd08:45:011
436115993325,4cyclictest0-21swapper/109:26:051
436115993324,6cyclictest421-21dbus-daemon11:05:011
43611599332,26cyclictest533632-21sh10:46:021
436114993327,4cyclictest460633-21fschecks_time08:30:550
436114993325,5cyclictest494291-21true09:45:010
43611699324,20cyclictest495560-21ssh09:46:042
436116993224,5cyclictest437595-21sh07:15:002
436116993224,5cyclictest0-21swapper/209:51:012
436116993222,6cyclictest261-21systemd-journal11:30:012
43611699322,25cyclictest568409-21ssh11:41:042
436116993221,3cyclictest171rcu_preempt11:45:372
436116993220,7cyclictest584104-21sh12:06:052
43611699321,23cyclictest485939-21sshd09:31:012
436115993226,3cyclictest0-21swapper/110:05:021
436115993225,4cyclictest559469-21timerwakeupswit11:26:131
436115993225,4cyclictest468104-21fschecks_count08:55:561
436115993224,5cyclictest0-21swapper/110:51:021
436115993224,4cyclictest0-21swapper/110:00:011
436115993223,6cyclictest439034-21unixbench_singl07:16:141
436115993222,7cyclictest568813-21timerwakeupswit11:41:121
43611499327,14cyclictest151ktimers/008:26:120
436114993225,4cyclictest587249-21ntp_offset12:11:040
436116993125,3cyclictest0-21swapper/212:31:042
436116993124,3cyclictest552728-21kworker/u8:0-xprtiod11:31:142
436116993124,3cyclictest0-21swapper/212:26:042
436116993121,7cyclictest466964-21ntp_kernel_pll_08:51:012
436116993116,9cyclictest602168-21/usr/sbin/munin12:35:502
436115993125,3cyclictest0-21swapper/107:55:011
436115993124,4cyclictest488863-21kernelversion09:35:571
436115993124,3cyclictest0-21swapper/112:01:081
436115993123,5cyclictest462700-21mailstats08:36:111
436115993123,5cyclictest1054-21mta-sts-daemon12:06:071
436115993121,7cyclictest479468-21latency09:21:011
43611499313,21cyclictest571545-21ssh11:46:030
436114993127,2cyclictest0-21swapper/012:40:010
43611499312,23cyclictest473431-21ssh09:11:050
436114993120,7cyclictest12350irq/32-eth011:06:010
436114993119,10cyclictest441987-21tail07:26:120
436114993118,10cyclictest560943-21latency_hist11:30:020
43611499311,14cyclictest498964-21mailstats09:51:120
43611699309,5cyclictest36-21ksoftirqd/209:11:042
43611699309,4cyclictest36-21ksoftirqd/209:06:052
43611699309,3cyclictest36-21ksoftirqd/208:00:552
43611699308,9cyclictest36-21ksoftirqd/208:20:572
43611699303,19cyclictest555908-21sh11:21:062
436116993023,3cyclictest0-21swapper/210:30:532
436116993011,5cyclictest36-21ksoftirqd/212:21:162
436116993011,4cyclictest36-21ksoftirqd/210:15:012
436116993010,11cyclictest36-21ksoftirqd/207:41:042
436115993024,3cyclictest0-21swapper/112:11:041
436115993024,3cyclictest0-21swapper/110:26:071
436115993022,5cyclictest532457-21latency_hist10:45:021
436115993022,5cyclictest437505-21tail07:11:151
436115993021,6cyclictest511888-21grep10:11:101
436115993021,6cyclictest445129-21systemd-run07:40:011
43611499303,20cyclictest565207-21ssh11:36:030
436114993024,4cyclictest443589-21cron07:35:010
436114993024,4cyclictest438970-21tail07:16:140
436114993024,4cyclictest436113-21cyclictest10:50:590
436114993024,4cyclictest3835474-21cups-browsed08:01:280
436114993023,4cyclictest551423-21cron11:15:010
436114993023,4cyclictest0-21swapper/011:21:030
436114993022,6cyclictest593376-21needreboot12:21:000
436114993020,8cyclictest1054-21mta-sts-daemon08:05:530
436114993020,6cyclictest0-21swapper/011:00:570
436114993016,9cyclictest12350irq/32-eth008:51:020
436114993016,4cyclictest491089-21cron09:40:010
436116992920,5cyclictest437984-21aten_r2power_vo07:15:542
436116992918,8cyclictest455595-21/usr/sbin/munin08:15:012
436116992917,9cyclictest533427-21missed_timers10:45:572
436116992910,4cyclictest36-21ksoftirqd/207:30:572
436116992910,3cyclictest36-21ksoftirqd/208:46:022
436115992923,3cyclictest0-21swapper/108:11:041
43611599292,22cyclictest593580-21sh12:21:071
436115992921,5cyclictest446513-21unixbench_multi07:41:141
436115992920,6cyclictest555201-21aten_r2power_en11:20:531
436115992918,8cyclictest574398-21latency11:50:561
436115992915,10cyclictest3835471-21cupsd07:26:051
436114992924,3cyclictest0-21swapper/009:00:000
436114992924,2cyclictest0-21swapper/010:20:010
43611499292,14cyclictest552728-21kworker/u8:0+rpciod12:26:030
436114992919,8cyclictest590851-21unixbench_multi12:16:140
436114992914,4cyclictest526587-21aten_r2power_en10:35:520
43611699289,4cyclictest36-21ksoftirqd/209:00:582
43611699289,3cyclictest36-21ksoftirqd/207:25:572
43611699287,4cyclictest36-21ksoftirqd/209:16:012
43611699285,15cyclictest543145-21ssh11:01:022
436116992822,3cyclictest0-21swapper/209:00:012
436115992822,3cyclictest0-21swapper/109:31:121
436115992822,3cyclictest0-21swapper/109:10:011
436115992821,4cyclictest465145-21gltestperf08:45:571
436115992818,7cyclictest549658-21proc_pri11:11:081
436114992822,3cyclictest0-21swapper/007:21:120
436114992818,7cyclictest0-21swapper/009:25:580
43611699279,4cyclictest36-21ksoftirqd/207:10:012
43611699279,4cyclictest36-21ksoftirqd/207:10:012
43611599273,19cyclictest3835474-21cups-browsed08:51:021
436115992722,3cyclictest0-21swapper/108:06:071
436114992720,5cyclictest695-21cron07:15:000
436114992720,4cyclictest261-21systemd-journal09:56:020
436114992717,6cyclictest568406-21sh11:41:040
436115992622,2cyclictest0-21swapper/108:20:001
436115992617,6cyclictest439-21systemd-logind11:50:011
436114992620,4cyclictest444978-21tail07:36:160
436114992617,7cyclictest447453-21ntp_kernel_err07:46:030
43611599252,19cyclictest458051-21sshd08:21:061
43611499252,15cyclictest441-21gpm07:51:070
436114992520,3cyclictest511099-21kernelversion10:10:540
436114992520,3cyclictest1051-21mta-sts-daemon08:36:020
436114992516,7cyclictest583395-21aten_r2power_en12:05:520
436114992510,12cyclictest151ktimers/009:06:050
436115992315,5cyclictest460005-21unixbench_multi08:26:191
436115992315,5cyclictest3835474-21cups-browsed07:45:531
436114992316,5cyclictest548-21gdbus08:49:330
43611599229,9cyclictest421-21dbus-daemon07:10:011
43611599229,9cyclictest421-21dbus-daemon07:10:011
43611599221,15cyclictest461017-21ntpq08:31:041
43611499222,15cyclictest464072-21ntpq08:41:110
43611499221,18cyclictest457637-21fschecks_count08:20:550
43611499207,6cyclictest11950irq/38-mmc107:41:010
43611499202,14cyclictest436069-21munin-run07:10:000
43611499202,14cyclictest436069-21munin-run07:10:000
43611799173,8cyclictest0-21swapper/311:06:033
43611799173,7cyclictest0-21swapper/312:11:023
43611799172,7cyclictest0-21swapper/310:16:003
43611799171,9cyclictest0-21swapper/311:51:023
43611799171,8cyclictest0-21swapper/309:41:033
43611799171,7cyclictest0-21swapper/308:36:033
43611799162,9cyclictest0-21swapper/312:16:053
43611799162,8cyclictest0-21swapper/312:36:033
43611799162,6cyclictest0-21swapper/310:06:023
43611799161,8cyclictest0-21swapper/309:46:023
43611799152,7cyclictest0-21swapper/312:26:073
43611799152,7cyclictest0-21swapper/310:46:023
43611799151,7cyclictest0-21swapper/308:01:033
43611799151,6cyclictest0-21swapper/307:21:043
43611799143,5cyclictest0-21swapper/308:51:003
43611799142,8cyclictest0-21swapper/310:41:013
43611799142,6cyclictest0-21swapper/310:26:013
43611799142,6cyclictest0-21swapper/309:16:043
43611799141,7cyclictest0-21swapper/308:41:103
43611799141,6cyclictest0-21swapper/311:11:003
43611799141,6cyclictest0-21swapper/308:26:063
43611799133,7cyclictest0-21swapper/309:55:573
43611799133,7cyclictest0-21swapper/308:21:013
43611799132,7cyclictest0-21swapper/311:36:003
43611799132,7cyclictest0-21swapper/311:31:023
43611799132,7cyclictest0-21swapper/310:21:083
43611799132,7cyclictest0-21swapper/309:51:023
43611799132,7cyclictest0-21swapper/309:25:583
43611799132,7cyclictest0-21swapper/309:06:043
43611799132,6cyclictest0-21swapper/310:01:003
43611799132,6cyclictest0-21swapper/307:46:113
43611799132,5cyclictest0-21swapper/312:00:513
43611799132,5cyclictest0-21swapper/310:30:573
43611799132,5cyclictest0-21swapper/308:56:043
43611799131,8cyclictest0-21swapper/312:30:583
43611799131,7cyclictest0-21swapper/311:55:553
43611799131,7cyclictest0-21swapper/311:26:023
43611799131,7cyclictest0-21swapper/311:00:553
43611799131,7cyclictest0-21swapper/310:56:023
43611799131,7cyclictest0-21swapper/310:51:013
43611799131,7cyclictest0-21swapper/309:31:053
43611799131,7cyclictest0-21swapper/308:31:023
43611799131,6cyclictest0-21swapper/307:36:033
43611799131,6cyclictest0-21swapper/307:26:003
43611799131,6cyclictest0-21swapper/307:11:023
43611799122,7cyclictest0-21swapper/311:20:543
43611799122,6cyclictest0-21swapper/311:45:033
43611799122,6cyclictest0-21swapper/310:10:543
43611799121,7cyclictest0-21swapper/312:21:073
43611799121,7cyclictest0-21swapper/312:06:053
43611799121,7cyclictest0-21swapper/311:45:593
43611799121,7cyclictest0-21swapper/311:15:523
43611799121,7cyclictest0-21swapper/310:36:013
43611799121,7cyclictest0-21swapper/309:36:003
43611799121,7cyclictest0-21swapper/309:10:593
43611799121,6cyclictest0-21swapper/309:01:003
43611799121,6cyclictest0-21swapper/308:11:033
43611799112,5cyclictest0-21swapper/308:16:013
43611799111,6cyclictest0-21swapper/308:46:103
43611799111,6cyclictest0-21swapper/307:30:573
43611799111,6cyclictest0-21swapper/307:15:543
43611799111,5cyclictest0-21swapper/307:41:013
43611799103,5cyclictest0-21swapper/308:06:033
43611799102,5cyclictest0-21swapper/309:20:513
43611799101,6cyclictest0-21swapper/307:50:573
43611799100,5cyclictest0-21swapper/307:55:543
4361179991,4cyclictest0-21swapper/307:10:023
4361179991,4cyclictest0-21swapper/307:10:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional