You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-05 - 02:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot3s.osadl.org (updated Sun Jan 04, 2026 12:45:08)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2831791997366,3cyclictest0-21swapper/009:45:010
2831797996931,33cyclictest2848372-21cat12:30:011
2831797996931,33cyclictest1-21systemd07:20:001
283179799681,13cyclictest2842570-21sshd10:38:391
283179799672,13cyclictest2841012-21sshd10:05:221
283180599652,16cyclictest2847253-21cron12:10:013
283179799651,46cyclictest0-21swapper/109:40:031
283179799651,10cyclictest2845959-21sshd11:43:391
283179799651,10cyclictest2845959-21sshd11:43:391
283180599642,19cyclictest2836361-21cron08:40:003
2831797996421,38cyclictest2836689-21latency_hist08:45:021
283179799641,6cyclictest2836878-21sshd08:46:391
283179799632,7cyclictest2831974-21cron07:15:011
283179799631,9cyclictest2840773-21sshd10:03:391
283180599622,20cyclictest2837447-21munin-run09:00:013
283180599622,18cyclictest2838513-21latency_hist09:20:013
2831805996217,7cyclictest0-21swapper/311:05:343
2831805996217,7cyclictest0-21swapper/311:05:343
283179799622,5cyclictest2847822-21munin-run12:20:021
283179799622,5cyclictest2847822-21munin-run12:20:011
283179799622,5cyclictest2845212-21munin-run11:30:001
283179799622,12cyclictest2834058-21munin-run07:55:001
283179799621,7cyclictest2835053-21sshd08:10:391
2831805996128,26cyclictest2846744-21run-parts12:00:003
2831805996124,34cyclictest2845336-21latency_hist11:30:013
283180599611,19cyclictest2832777-21grep07:30:013
283180599611,19cyclictest2832777-21grep07:30:013
283179799612,7cyclictest2847246-21sshd12:08:391
283179799612,6cyclictest2838712-21sshd09:22:391
283179799612,15cyclictest2834350-21munin-run08:00:011
283179799611,5cyclictest2842102-21/usr/sbin/munin10:30:011
283179799611,5cyclictest2832776-21munin-run07:30:011
283179799611,5cyclictest2832776-21munin-run07:30:011
283179799611,12cyclictest2842838-21sshd10:40:391
2831805996015,8cyclictest2834818-21sshd08:09:393
283179799602,6cyclictest2848787-21sshd12:36:391
283179799602,14cyclictest2847016-21munin-run12:05:021
283179799602,11cyclictest2839527-21munin-run09:40:011
283179799601,6cyclictest2846485-21munin-run11:55:001
283179799601,4cyclictest2843384-21munin-run10:55:021
283179799601,13cyclictest2833262-21sshd07:39:531
283180599599,13cyclictest1-21systemd08:15:003
2831801995937,11cyclictest309-21in:imuxsock07:20:002
283179799592,7cyclictest2837393-21cron09:00:001
283179799592,12cyclictest2838985-21munin-run09:30:011
283179799592,11cyclictest2846700-21sshd11:55:391
283179799591,8cyclictest2843604-21sshd10:59:391
283179799591,5cyclictest2834839-21munin-run08:09:591
283179799591,11cyclictest2839998-21sshd09:49:391
283180599583,10cyclictest2837932-21modprobe09:09:593
2831805995814,10cyclictest275-21dbus-daemon08:20:013
2831801995838,14cyclictest238-21systemd-journal09:05:012
2831797995821,33cyclictest2840519-21latency_hist10:00:011
283179799581,7cyclictest2843885-21sshd11:04:391
283179799581,5cyclictest2844151-21munin-run11:10:011
283179799581,5cyclictest2844151-21munin-run11:10:011
283179799581,14cyclictest2837667-21sshd09:04:391
283179799581,13cyclictest2847497-21sshd12:13:391
2831791995839,13cyclictest2831793-21cat07:10:020
283180599572,18cyclictest2837009-21sort08:50:023
2831805995715,9cyclictest37-21ksoftirqd/307:52:393
2831805995714,6cyclictest2836830-21latency_hist08:45:033
283179799573,5cyclictest364-21snmpd12:23:171
283179799573,46cyclictest2840253-21modprobe09:55:001
283179799573,46cyclictest2840253-21modprobe09:55:001
283179799572,6cyclictest364-21snmpd10:47:591
283179799572,6cyclictest364-21snmpd10:47:591
283179799571,5cyclictest364-21snmpd08:27:321
283179799571,5cyclictest2833530-21sshd07:43:401
2831797995712,40cyclictest0-21swapper/111:15:291
283179799562,4cyclictest0-21swapper/110:17:531
283179799562,4cyclictest0-21swapper/109:32:451
283179799562,4cyclictest0-21swapper/109:32:451
283179799562,13cyclictest364-21snmpd08:51:251
283179799561,14cyclictest364-21snmpd07:22:201
283179799561,12cyclictest2836353-21sshd08:38:391
283179799561,10cyclictest2841803-21sshd10:20:241
2831805995519,4cyclictest2848818-21latency_hist12:40:033
283180599551,20cyclictest2841809-21sshd10:20:393
2831801995536,14cyclictest1-21systemd08:30:002
283179799553,4cyclictest364-21snmpd08:22:311
283179799552,5cyclictest2836124-21munin-run08:35:001
283179799552,12cyclictest2837906-21sshd09:05:391
283179799551,5cyclictest364-21snmpd11:48:101
283179799551,5cyclictest2848537-21sshd12:31:391
283179799551,5cyclictest2842325-21sshd10:34:391
283179799551,12cyclictest364-21snmpd08:04:411
283179799551,12cyclictest364-21snmpd08:04:411
283180599543,19cyclictest1-21systemd09:55:013
283180599543,19cyclictest1-21systemd09:55:013
283180599543,11cyclictest2834588-21munin-run08:05:003
283180599543,11cyclictest2834588-21munin-run08:05:003
2831805995418,4cyclictest2832203-21sshd07:15:393
2831805995410,9cyclictest309-21in:imuxsock09:35:013
2831805995410,9cyclictest309-21in:imuxsock09:35:013
283179799542,5cyclictest2838167-21sshd09:10:391
283179799542,11cyclictest2833028-21munin-plugin-st07:35:001
283179799541,11cyclictest364-21snmpd09:18:131
283180599532,16cyclictest1-21systemd12:35:013
283179799532,7cyclictest2845670-21sshd11:35:391
2831791995314,34cyclictest2837905-21kworker/u8:209:10:000
2831801995240,8cyclictest2848312-21grep12:30:002
2831797995235,12cyclictest2835355-21run-parts08:20:001
283179799522,15cyclictest364-21snmpd10:14:091
283179799522,15cyclictest364-21snmpd10:14:091
283179799521,4cyclictest364-21snmpd11:13:031
283180599512,19cyclictest238-21systemd-journal11:15:003
2831805995118,4cyclictest2833560-21sh07:45:013
2831805995114,5cyclictest2847075-21cat12:05:023
283180599511,19cyclictest2843619-21cron11:00:003
2831801995139,8cyclictest30-21ksoftirqd/208:35:012
283179799518,38cyclictest0-21swapper/111:35:001
283179799514,4cyclictest0-21swapper/111:22:081
283179799514,4cyclictest0-21swapper/111:22:081
283179799511,5cyclictest2833776-21sshd07:46:391
2831791995146,2cyclictest0-21swapper/008:15:010
283180599502,17cyclictest2832126-21latency_hist07:15:023
2831805995020,4cyclictest2845044-21latency_hist11:25:023
2831805995020,4cyclictest2845044-21latency_hist11:25:023
2831805995020,10cyclictest37-21ksoftirqd/310:15:023
2831805995020,10cyclictest37-21ksoftirqd/310:15:023
2831805995014,8cyclictest2840062-21latency_hist09:50:013
2831805995011,12cyclictest1-21systemd08:25:013
2831805995010,6cyclictest0-21swapper/311:55:023
283180199508,5cyclictest131rcu_preempt09:40:002
283179199502,42cyclictest2844676-21munin-run11:20:000
2831805994912,10cyclictest37-21ksoftirqd/307:25:003
283180199494,38cyclictest30-21ksoftirqd/212:40:022
2831801994933,13cyclictest30-21ksoftirqd/207:51:392
2831801994932,14cyclictest275-21dbus-daemon08:40:012
2831791994931,14cyclictest238-21systemd-journal08:45:010
283179799482,11cyclictest2831840-21latency_hist07:10:021
2831791994839,5cyclictest0-21swapper/008:00:000
283180599472,30cyclictest361rcuc/308:30:023
2831801994734,10cyclictest30-21ksoftirqd/212:00:022
2831801994711,5cyclictest131rcu_preempt10:00:002
2831801994710,5cyclictest131rcu_preempt10:20:002
2831791994634,9cyclictest12-21ksoftirqd/012:40:020
283180599453,3cyclictest131rcu_preempt12:15:013
2831801994527,13cyclictest275-21dbus-daemon09:30:012
283179199453,3cyclictest131rcu_preempt10:10:000
2831791994528,12cyclictest1-21systemd10:15:010
2831791994528,12cyclictest1-21systemd10:15:010
283179199451,40cyclictest2845703-21cron11:40:000
2831805994419,8cyclictest37-21ksoftirqd/310:05:013
2831805994414,9cyclictest2843973-21date11:05:023
283180199448,6cyclictest131rcu_preempt11:35:012
2831801994434,6cyclictest30-21ksoftirqd/210:30:022
2831801994432,9cyclictest30-21ksoftirqd/211:20:002
2831801994430,9cyclictest30-21ksoftirqd/210:25:012
2831801994421,16cyclictest275-21dbus-daemon11:15:002
2831791994437,4cyclictest16950irq/224-800000011:55:010
2831791994437,4cyclictest16950irq/224-800000011:45:010
2831791994437,4cyclictest16950irq/224-800000011:45:010
2831791994437,4cyclictest16950irq/224-800000007:45:010
2831791994429,11cyclictest238-21systemd-journal07:20:000
2831791994426,13cyclictest275-21dbus-daemon10:40:000
2831805994334,5cyclictest309-21in:imuxsock10:40:003
2831805994331,8cyclictest37-21ksoftirqd/309:30:013
283180199435,25cyclictest2824444-21kworker/u8:307:35:022
283180199434,30cyclictest291rcuc/207:40:022
2831801994333,6cyclictest30-21ksoftirqd/212:10:002
2831801994328,11cyclictest275-21dbus-daemon11:45:022
2831801994328,11cyclictest275-21dbus-daemon11:45:022
2831791994331,8cyclictest1-21systemd09:24:590
2831791994331,8cyclictest1-21systemd07:25:010
2831791994326,12cyclictest275-21dbus-daemon11:10:010
2831791994326,12cyclictest275-21dbus-daemon11:10:010
2831791994326,12cyclictest1-21systemd08:50:000
283180599427,9cyclictest37-21ksoftirqd/309:41:403
2831801994232,5cyclictest2835264-21latency_hist08:15:022
2831801994231,8cyclictest1-21systemd08:25:012
2831801994231,7cyclictest30-21ksoftirqd/207:40:022
2831801994224,12cyclictest0-21swapper/210:15:012
2831801994224,12cyclictest0-21swapper/210:15:012
2831801994220,15cyclictest275-21dbus-daemon10:05:012
2831791994227,11cyclictest12-21ksoftirqd/012:25:010
2831791994226,9cyclictest2836363-21modprobe08:40:000
283179199422,5cyclictest0-21swapper/012:10:010
283179199421,37cyclictest0-21swapper/011:05:010
283180199416,12cyclictest2836343-21kworker/u8:109:00:022
2831801994128,10cyclictest1-21systemd11:30:002
2831801994125,8cyclictest2842600-21grep10:40:002
2831801994124,11cyclictest275-21dbus-daemon08:05:012
2831801994124,11cyclictest275-21dbus-daemon08:05:002
283180199411,9cyclictest30-21ksoftirqd/212:05:012
283179199417,6cyclictest2840835-21latency_hist10:05:010
283179199413,6cyclictest2844960-21unin-run11:25:010
283179199413,6cyclictest2844960-21unin-run11:25:010
283179199413,24cyclictest151rcuc/007:15:030
283179199412,8cyclictest275-21dbus-daemon10:00:000
2831791994126,11cyclictest2841565-21modprobe10:20:000
2831791994125,10cyclictest309-21in:imuxsock12:00:000
2831791994124,13cyclictest2843348-21sshd10:53:390
2831791994124,13cyclictest238-21systemd-journal08:55:000
283180599407,5cyclictest131rcu_preempt12:25:023
2831805994028,9cyclictest37-21ksoftirqd/309:15:003
283180599401,3cyclictest131rcu_preempt10:20:013
283180199409,19cyclictest30-21ksoftirqd/209:15:022
2831801994026,11cyclictest238-21systemd-journal10:41:392
2831801994026,10cyclictest2843597-21sshd10:57:392
2831801994021,14cyclictest275-21dbus-daemon11:55:002
2831801994012,5cyclictest131rcu_preempt08:00:022
2831791994031,6cyclictest2842867-21latency_hist10:45:000
2831791994028,7cyclictest309-21in:imuxsock07:30:010
2831791994028,7cyclictest309-21in:imuxsock07:30:010
2831791994028,10cyclictest12-21ksoftirqd/010:30:020
2831791994027,10cyclictest2834032-21sshd07:53:400
2831791994027,10cyclictest12-21ksoftirqd/012:15:020
2831791994025,12cyclictest1-21systemd11:00:010
2831791994025,10cyclictest2847786-21cat12:20:010
2831791994025,10cyclictest2847786-21cat12:20:000
2831791994024,11cyclictest12-21ksoftirqd/009:35:020
2831791994024,11cyclictest12-21ksoftirqd/009:35:020
283179199402,34cyclictest2845450-21munin-run11:35:000
2831791994021,14cyclictest238-21systemd-journal08:55:040
2831805993926,9cyclictest2840536-21tr10:00:003
2831805993922,12cyclictest275-21dbus-daemon07:35:003
283180599391,3cyclictest131rcu_preempt07:50:003
283180199398,17cyclictest30-21ksoftirqd/212:25:022
283180199393,9cyclictest30-21ksoftirqd/207:15:012
2831801993924,11cyclictest238-21systemd-journal12:31:392
2831801993918,14cyclictest238-21systemd-journal09:35:002
2831801993918,14cyclictest238-21systemd-journal09:35:002
2831791993932,4cyclictest16950irq/224-800000008:30:010
2831791993929,6cyclictest2838183-21cron09:15:000
2831791993928,9cyclictest12-21ksoftirqd/011:15:010
283179199392,33cyclictest0-21swapper/012:05:020
283179199391,34cyclictest382-21ntpd09:40:000
283179199391,34cyclictest0-21swapper/012:30:020
283180599382,3cyclictest131rcu_preempt12:30:003
2831805993822,12cyclictest2836228-21wc08:35:023
283180199384,6cyclictest131rcu_preempt11:50:002
2831801993831,5cyclictest30-21ksoftirqd/208:55:042
2831801993828,7cyclictest30-21ksoftirqd/211:10:022
2831801993828,7cyclictest30-21ksoftirqd/211:10:022
2831801993821,12cyclictest275-21dbus-daemon10:55:002
2831801993818,13cyclictest275-21dbus-daemon10:35:002
283179199388,6cyclictest131rcu_preempt11:30:000
2831791993825,9cyclictest2840056-21latency_hist09:50:010
283180199372,24cyclictest238-21systemd-journal09:14:592
2831801993722,11cyclictest30-21ksoftirqd/212:20:002
2831801993722,11cyclictest30-21ksoftirqd/212:20:002
2831801993718,14cyclictest275-21dbus-daemon08:50:002
2831801993716,14cyclictest238-21systemd-journal11:40:002
283179199373,30cyclictest2841840-21munin-run10:25:000
283179199372,6cyclictest2838463-21munin-run09:20:000
283179199372,31cyclictest2833509-21date07:40:020
2831805993624,9cyclictest37-21ksoftirqd/311:45:023
2831805993624,9cyclictest37-21ksoftirqd/311:45:023
283180199363,7cyclictest131rcu_preempt12:15:012
2831801993628,4cyclictest2843898-21latency_hist11:05:012
2831801993623,10cyclictest30-21ksoftirqd/208:20:012
2831801993621,11cyclictest30-21ksoftirqd/208:45:012
2831801993621,11cyclictest30-21ksoftirqd/207:25:012
283180199361,14cyclictest0-21swapper/211:25:022
283180199361,14cyclictest0-21swapper/211:25:022
283179199362,4cyclictest0-21swapper/009:55:020
283179199362,4cyclictest0-21swapper/009:55:020
283179199361,10cyclictest2833785-21sshd07:49:390
2831805993528,4cyclictest2842982-21latency_hist10:45:023
2831805993528,4cyclictest1-21systemd10:55:003
283180199354,24cyclictest2834838-21modprobe08:10:002
2831801993523,7cyclictest30-21ksoftirqd/207:30:012
2831801993523,7cyclictest30-21ksoftirqd/207:30:012
2831801993522,9cyclictest30-21ksoftirqd/210:50:002
2831801993522,9cyclictest30-21ksoftirqd/210:50:002
283179199359,4cyclictest0-21swapper/008:35:010
2831791993526,5cyclictest2834725-21latency_hist08:05:020
2831791993526,5cyclictest2834725-21latency_hist08:05:020
2831791993525,8cyclictest12-21ksoftirqd/009:05:020
2831791993524,8cyclictest12-21ksoftirqd/009:30:010
2831791993522,11cyclictest12-21ksoftirqd/012:31:390
283179199351,5cyclictest2832997-21sshd07:32:400
2831805993421,9cyclictest2844653-21cron11:20:003
2831805993421,9cyclictest2842229-21wc10:30:023
2831801993426,5cyclictest30-21ksoftirqd/209:10:012
2831801993424,7cyclictest0-21swapper/207:10:022
2831805993325,6cyclictest2837681-21latency_hist09:05:023
2831805993323,8cyclictest37-21ksoftirqd/308:55:013
2831801993324,7cyclictest30-21ksoftirqd/209:50:022
2831801993321,8cyclictest30-21ksoftirqd/207:50:022
2831791993326,4cyclictest2842518-21latency_hist10:35:020
2831791993323,7cyclictest0-21swapper/011:50:010
2831791993323,5cyclictest2835353-21cat08:20:000
283179199331,28cyclictest0-21swapper/008:22:390
2831805993224,5cyclictest2834512-21latency_hist08:00:023
283180599322,3cyclictest131rcu_preempt09:40:003
2831805993218,10cyclictest1-21systemd11:40:013
2831801993220,10cyclictest30-21ksoftirqd/209:45:012
2831791993224,6cyclictest12-21ksoftirqd/010:50:030
2831791993224,6cyclictest12-21ksoftirqd/010:50:020
2831791993222,8cyclictest12-21ksoftirqd/008:06:390
2831805993124,4cyclictest2833281-21latency_hist07:40:013
2831805993123,5cyclictest2842427-21latency_hist10:35:013
2831805993116,12cyclictest2838714-21sshd09:22:383
2831805993114,13cyclictest275-21dbus-daemon11:50:003
2831801993118,8cyclictest30-21ksoftirqd/209:25:002
283180199311,6cyclictest0-21swapper/210:05:392
283180599304,3cyclictest131rcu_preempt10:10:013
2831805993024,4cyclictest2847781-21latency_hist12:20:023
2831805993024,4cyclictest2847781-21latency_hist12:20:023
2831805993022,5cyclictest2843154-21latency_hist10:50:023
2831805993022,5cyclictest2843154-21latency_hist10:50:023
2831801993011,5cyclictest131rcu_preempt09:55:012
2831801993011,5cyclictest131rcu_preempt09:55:012
283180599292,4cyclictest131rcu_preempt11:35:013
2831805992717,7cyclictest37-21ksoftirqd/307:10:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional