You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-02 - 03:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Fri Jan 02, 2026 00:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2631248995544,8cyclictest311ktimers/222:55:142
2631252995140,7cyclictest2728364-21grep23:45:273
2631252995135,13cyclictest391ktimers/320:15:133
2631248994836,9cyclictest311ktimers/221:10:132
2631248994836,9cyclictest311ktimers/221:10:132
2631240994820,3cyclictest2707876-21head22:45:270
2631252994741,4cyclictest2735452-21kworker/u8:2+events_unbound00:27:553
2631252994634,9cyclictest391ktimers/323:00:123
2631240994619,5cyclictest2643531-21grep19:40:260
2631240994617,7cyclictest0-21swapper/023:25:300
2631240994416,6cyclictest0-21swapper/020:05:010
2631252994337,4cyclictest2697885-21kworker/u8:2+events_unbound22:22:403
2631252994332,8cyclictest391ktimers/323:25:143
2631248994232,5cyclictest0-21swapper/222:20:002
2631252994135,4cyclictest2656450-21kworker/u8:0+events_unbound20:37:283
2631252994131,5cyclictest0-21swapper/319:30:163
2631252994130,7cyclictest0-21swapper/319:15:023
2631252994130,7cyclictest0-21swapper/319:15:013
2631248994130,7cyclictest2650997-21unixbench_singl20:00:272
2631248994129,9cyclictest311ktimers/220:05:132
2631252994033,5cyclictest2735452-21kworker/u8:2+events_unbound00:12:543
2631248994033,4cyclictest2635390-21munin-plugin-st19:20:002
2631243994033,4cyclictest2703163-21sh22:35:001
2631243994033,4cyclictest2703163-21sh22:35:001
2631252993927,4cyclictest131rcu_preempt19:58:563
2631252993922,10cyclictest131rcu_preempt22:30:153
2631252993922,10cyclictest131rcu_preempt22:30:153
2631248993927,8cyclictest0-21swapper/200:00:002
2631248993922,14cyclictest311ktimers/220:30:152
2631240993932,4cyclictest2739103-21sendmail00:20:000
2631252993831,5cyclictest2654615-21kworker/u8:1+events_unbound20:12:263
2631252993829,5cyclictest0-21swapper/322:40:153
2631252993825,9cyclictest391ktimers/320:45:123
2631248993827,7cyclictest2645415-21grep19:45:302
2631248993827,7cyclictest0-21swapper/221:15:162
2631243993831,4cyclictest2668924-21fschecks_count20:55:171
2631240993831,4cyclictest0-21swapper/021:20:000
2631240993828,6cyclictest0-21swapper/023:05:010
2631252993730,5cyclictest2715064-21kworker/u8:2+events_unbound23:14:413
2631252993728,5cyclictest2715138-21sh23:10:013
2631252993719,4cyclictest0-21swapper/321:09:293
2631252993719,4cyclictest0-21swapper/321:09:293
2631248993732,3cyclictest2631251-21latency_hist19:10:012
2631248993727,6cyclictest2704403-21grep22:35:282
2631248993727,6cyclictest2704403-21grep22:35:282
2631243993726,7cyclictest0-21swapper/120:50:261
2631252993630,4cyclictest2731933-21kworker/u8:1+events_unbound23:56:423
2631252993626,4cyclictest2716820-21kworker/u8:1+events_unbound23:17:483
2631252993625,8cyclictest391ktimers/319:20:123
2631252993625,4cyclictest131rcu_preempt21:55:013
2631252993624,8cyclictest0-21swapper/320:20:263
2631252993623,5cyclictest131rcu_preempt21:14:113
2631252993623,5cyclictest131rcu_preempt21:14:113
2631252993622,4cyclictest2632872-21kworker/u8:1-events_power_efficient19:16:513
2631252993617,11cyclictest131rcu_preempt19:51:363
2631252993612,12cyclictest131rcu_preempt20:54:093
2631248993619,12cyclictest311ktimers/222:40:132
2631243993628,4cyclictest0-21swapper/120:00:011
2631243993626,6cyclictest0-21swapper/119:25:161
2631243993626,6cyclictest0-21swapper/119:25:161
2631252993529,4cyclictest2666592-21kworker/u8:0+events_unbound21:24:413
2631252993528,3cyclictest0-21swapper/300:30:243
2631252993523,5cyclictest131rcu_preempt22:10:143
2631252993522,5cyclictest131rcu_preempt22:45:263
2631252993520,5cyclictest131rcu_preempt21:18:283
2631248993525,7cyclictest311ktimers/219:40:122
2631248993525,6cyclictest2724942-21grep23:35:272
2631243993527,4cyclictest0-21swapper/123:22:461
2631243993526,6cyclictest2736906-21unixbench_multi00:10:261
2631243993525,6cyclictest2682436-21idleruntime-cro21:35:011
2631240993528,3cyclictest0-21swapper/022:10:260
2631252993427,5cyclictest2707953-21kworker/u8:1+events_unbound22:56:413
2631252993426,4cyclictest0-21swapper/320:40:283
2631252993422,5cyclictest131rcu_preempt23:35:173
2631252993422,5cyclictest131rcu_preempt00:35:283
2631252993422,4cyclictest131rcu_preempt22:38:123
2631252993422,4cyclictest131rcu_preempt22:38:123
2631252993421,9cyclictest391ktimers/322:25:143
2631252993421,8cyclictest0-21swapper/321:55:263
2631252993420,4cyclictest131rcu_preempt19:38:333
2631252993417,10cyclictest131rcu_preempt21:30:243
2631252993415,9cyclictest131rcu_preempt22:01:053
2631252993415,11cyclictest131rcu_preempt00:24:533
2631252993411,13cyclictest40-21ksoftirqd/323:20:173
2631248993427,4cyclictest2739109-21sendmail00:20:002
2631248993426,4cyclictest0-21swapper/223:40:252
2631248993426,4cyclictest0-21swapper/221:55:012
2631248993424,6cyclictest0-21swapper/222:15:012
2631248993422,9cyclictest2715153-21idleruntime-cro23:10:012
2631243993426,4cyclictest0-21swapper/121:40:011
2631243993424,7cyclictest2688200-21runrttasks21:50:191
2631240993426,5cyclictest0-21swapper/021:05:270
2631240993426,5cyclictest0-21swapper/021:05:270
2631252993323,7cyclictest2739086-21apt-get00:20:003
2631252993319,5cyclictest131rcu_preempt21:27:243
2631252993319,4cyclictest131rcu_preempt20:03:113
2631252993319,4cyclictest131rcu_preempt19:43:113
2631252993318,5cyclictest131rcu_preempt20:27:303
2631252993316,4cyclictest131rcu_preempt22:17:403
2631252993316,4cyclictest131rcu_preempt19:49:403
2631252993315,4cyclictest131rcu_preempt00:05:003
2631252993315,3cyclictest0-21swapper/321:00:413
2631252993315,3cyclictest0-21swapper/321:00:413
2631248993325,4cyclictest0-21swapper/223:30:162
2631248993321,8cyclictest2632650-21grep19:10:272
2631248993321,8cyclictest2632650-21grep19:10:272
2631243993326,4cyclictest0-21swapper/120:15:181
2631243993324,6cyclictest2734414-21cut00:05:171
2631240993325,4cyclictest0-21swapper/019:45:300
2631240993325,4cyclictest0-21swapper/000:15:000
2631252993220,5cyclictest131rcu_preempt21:38:333
2631252993219,5cyclictest131rcu_preempt20:05:173
2631252993217,3cyclictest131rcu_preempt19:27:423
2631252993217,3cyclictest131rcu_preempt19:27:423
2631252993216,4cyclictest131rcu_preempt23:34:063
2631252993214,11cyclictest131rcu_preempt23:45:003
2631248993222,6cyclictest0-21swapper/223:50:262
2631243993223,6cyclictest0-21swapper/119:20:001
2631243993221,6cyclictest0-21swapper/123:25:301
2631240993223,6cyclictest0-21swapper/021:20:250
2631240993222,6cyclictest0-21swapper/019:10:020
2631240993221,6cyclictest0-21swapper/022:25:270
263125299316,7cyclictest40-21ksoftirqd/323:55:003
263125299314,5cyclictest40-21ksoftirqd/321:45:273
2631252993124,5cyclictest2666592-21kworker/u8:0+events_unbound20:58:383
2631252993115,4cyclictest131rcu_preempt22:06:513
2631252993114,5cyclictest131rcu_preempt00:05:173
2631252993110,5cyclictest131rcu_preempt20:30:193
2631248993123,5cyclictest2693948-21unixbench_multi22:05:302
2631243993125,4cyclictest2732246-21munin-plugin-st00:00:001
2631243993124,4cyclictest2739122-21kworker/u8:200:20:001
2631243993124,4cyclictest2653137-21kthreadd20:10:011
2631243993124,3cyclictest0-21swapper/119:40:011
2631243993121,6cyclictest0-21swapper/120:32:261
2631240993123,4cyclictest0-21swapper/019:57:220
2631240993123,4cyclictest0-21swapper/000:30:000
2631240993121,6cyclictest0-21swapper/021:55:010
2631240993121,6cyclictest0-21swapper/021:40:270
2631240993120,8cyclictest2668520-21cron20:54:590
2631240993119,7cyclictest0-21swapper/020:30:300
2631252993022,6cyclictest2706243-21kworker/u8:0+events_unbound22:50:403
2631248993023,3cyclictest0-21swapper/223:15:272
2631243993020,7cyclictest2687561-21sh21:50:001
2631240993023,3cyclictest0-21swapper/021:05:010
2631240993023,3cyclictest0-21swapper/021:05:010
2631240993021,6cyclictest0-21swapper/019:40:010
2631240993021,5cyclictest0-21swapper/000:10:000
2631252992910,12cyclictest2685853-21cron21:45:013
263124899298,5cyclictest131rcu_preempt00:35:272
2631243992922,4cyclictest0-21swapper/121:15:161
2631243992919,7cyclictest0-21swapper/120:40:171
2631240992920,6cyclictest2668921-21grep20:55:170
2631240992920,6cyclictest0-21swapper/000:40:000
2631240992920,5cyclictest0-21swapper/022:15:270
2631240992918,6cyclictest0-21swapper/000:00:280
2631248992822,4cyclictest2679442-21fschecks_time21:25:172
2631248992821,3cyclictest0-21swapper/223:50:002
2631248992820,5cyclictest311ktimers/220:25:012
2631248992820,4cyclictest0-21swapper/223:20:262
2631248992819,5cyclictest0-21swapper/219:35:272
2631248992818,7cyclictest2671498-21grep21:00:302
2631248992818,7cyclictest2671498-21grep21:00:302
263124899281,5cyclictest26626132grep20:35:272
2631243992821,4cyclictest2663392-21sh20:40:001
2631243992818,6cyclictest2643528-21sed19:40:261
2631243992818,6cyclictest0-21swapper/100:00:281
2631243992817,7cyclictest0-21swapper/122:45:271
2631240992819,6cyclictest0-21swapper/020:45:270
2631248992718,4cyclictest0-21swapper/221:40:012
2631248992716,7cyclictest2702716-21grep22:30:272
2631248992716,7cyclictest2702716-21grep22:30:272
2631243992722,3cyclictest53-21kcompactd021:24:591
2631243992718,5cyclictest2745718-21head00:35:281
2631240992720,4cyclictest2633670-21latency_hist19:15:030
2631240992720,3cyclictest0-21swapper/019:25:000
2631240992719,5cyclictest0-21swapper/023:05:290
2631240992719,3cyclictest0-21swapper/020:20:010
2631240992718,5cyclictest0-21swapper/020:30:000
2631240992717,6cyclictest0-21swapper/019:25:260
2631240992717,6cyclictest0-21swapper/019:25:260
2631248992620,3cyclictest0-21swapper/222:20:202
2631248992619,3cyclictest0-21swapper/220:40:212
2631248992618,5cyclictest2668105-21unixbench_singl20:50:262
2631248992618,5cyclictest0-21swapper/221:55:272
2631248992618,5cyclictest0-21swapper/219:25:262
2631248992618,5cyclictest0-21swapper/219:25:262
2631248992618,4cyclictest0-21swapper/200:05:112
2631248992618,3cyclictest0-21swapper/222:25:272
2631248992616,6cyclictest2709551-21grep22:50:282
2631243992620,3cyclictest0-21swapper/120:00:241
2631243992619,3cyclictest0-21swapper/120:25:191
2631243992615,6cyclictest0-21swapper/119:45:301
2631240992620,3cyclictest13550irq/42-30be0000.ethernet21:40:010
2631240992619,4cyclictest2680727-21kthreadd21:30:000
2631240992617,6cyclictest0-21swapper/021:10:280
2631240992617,6cyclictest0-21swapper/021:10:280
2631240992617,6cyclictest0-21swapper/019:20:010
2631240992617,5cyclictest0-21swapper/022:55:280
2631240992616,7cyclictest2709597-21grep22:50:280
2631240992616,6cyclictest2723267-21grep23:30:270
2631240992616,6cyclictest0-21swapper/021:30:150
2631240992614,9cyclictest2687096-21grep21:45:270
2631248992518,3cyclictest0-21swapper/222:05:012
2631248992517,5cyclictest0-21swapper/200:30:002
2631243992519,3cyclictest0-21swapper/123:05:011
2631243992519,3cyclictest0-21swapper/100:25:181
2631243992518,4cyclictest2698036-21cron22:20:001
2631243992518,4cyclictest0-21swapper/122:45:001
2631243992515,6cyclictest2728822-21cron23:50:001
2631243992515,6cyclictest0-21swapper/123:40:001
2631243992513,8cyclictest2743146-21uniq00:30:171
2631240992517,4cyclictest2663420-21sendmail-msp20:40:000
2631240992516,5cyclictest0-21swapper/023:35:270
263124099251,5cyclictest2691227-21apt-get22:00:130
2631240992515,7cyclictest2699149-21sed22:20:250
2631240992515,6cyclictest2706129-21grep22:40:250
2631240992514,7cyclictest0-21swapper/020:05:260
263124099251,3cyclictest2739086-21apt-get00:20:040
263124099251,2cyclictest0-21swapper/020:10:120
263124099251,20cyclictest0-21swapper/019:52:180
2631248992417,4cyclictest0-21swapper/219:30:252
2631248992416,4cyclictest0-21swapper/219:55:272
2631248992416,4cyclictest0-21swapper/219:20:162
2631248992414,7cyclictest2736902-21unixbench_multi00:10:252
2631243992415,6cyclictest2740603-21grep00:20:261
2631243992413,7cyclictest0-21swapper/121:05:271
2631243992413,7cyclictest0-21swapper/121:05:271
263124099246,4cyclictest131rcu_preempt22:10:010
2631240992416,5cyclictest0-21swapper/000:30:270
2631240992415,6cyclictest2730083-21grep23:50:260
263124099241,4cyclictest2718807-21apt-get23:20:130
2631240992414,6cyclictest0-21swapper/022:30:170
2631240992414,6cyclictest0-21swapper/022:30:170
2631240992413,6cyclictest0-21swapper/023:15:170
263124099241,19cyclictest0-21swapper/023:59:000
263124099241,19cyclictest0-21swapper/023:43:340
263124099241,19cyclictest0-21swapper/019:12:450
263124099240,20cyclictest0-21swapper/022:37:110
263124099240,20cyclictest0-21swapper/022:37:100
2631248992317,3cyclictest0-21swapper/221:20:252
2631248992316,4cyclictest0-21swapper/223:00:262
2631248992314,6cyclictest0-21swapper/223:15:012
2631243992315,5cyclictest0-21swapper/119:30:251
2631243992314,6cyclictest0-21swapper/120:20:161
2631243992313,6cyclictest0-21swapper/120:45:271
2631243992311,9cyclictest2717083-21apt-get23:15:131
2631243992311,10cyclictest2631232-21cyclictest21:10:131
2631243992311,10cyclictest2631232-21cyclictest21:10:131
263124099233,14cyclictest13550irq/42-30be0000.ethernet23:45:120
263124099231,18cyclictest0-21swapper/020:24:400
2631248992214,4cyclictest0-21swapper/220:45:272
2631248992213,7cyclictest2685401-21awk21:40:272
2631248992211,6cyclictest2654417-21grep20:10:262
2631243992216,3cyclictest0-21swapper/122:50:161
2631243992216,3cyclictest0-21swapper/122:20:111
2631243992216,3cyclictest0-21swapper/122:10:141
2631243992216,3cyclictest0-21swapper/121:25:151
2631243992213,4cyclictest0-21swapper/123:10:251
2631243992212,7cyclictest2713854-21/usr/sbin/munin23:05:181
2631243992212,7cyclictest2654424-21awk20:10:261
2631243992211,8cyclictest2729838-21wc23:50:241
2631240992215,3cyclictest0-21swapper/019:32:030
263124099221,17cyclictest0-21swapper/023:12:560
2631248992115,4cyclictest311ktimers/219:50:152
2631248992113,5cyclictest311ktimers/222:45:182
2631248992113,4cyclictest0-21swapper/200:00:242
2631248992111,6cyclictest2740612-21grep00:20:272
2631243992115,3cyclictest0-21swapper/122:55:271
2631243992114,4cyclictest0-21swapper/123:30:161
2631240992115,4cyclictest2663824-21fschecks_time20:40:170
2631248992014,3cyclictest2668757-21/usr/sbin/munin20:55:192
2631248992014,3cyclictest0-21swapper/221:05:182
2631248992014,3cyclictest0-21swapper/221:05:182
2631248992014,3cyclictest0-21swapper/220:15:292
2631248992012,5cyclictest0-21swapper/221:45:252
2631248992011,6cyclictest0-21swapper/221:30:222
2631243992015,3cyclictest0-21swapper/121:00:201
2631243992015,3cyclictest0-21swapper/121:00:201
2631243992014,4cyclictest2693666-21mailstats22:05:281
2631243992014,3cyclictest0-21swapper/119:50:171
2631248991911,6cyclictest311ktimers/220:25:262
2631248991911,5cyclictest0-21swapper/200:30:162
2631243991913,4cyclictest231ktimers/121:40:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional