You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-27 - 18:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot3s.osadl.org (updated Thu Nov 27, 2025 12:45:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
251595998529,52cyclictest16950irq/224-800000011:15:010
25159599712,63cyclictest257071-21latency_hist08:55:020
251595996927,37cyclictest235-21systemd-journal08:40:010
251601996813,18cyclictest260694-21latency_hist10:05:012
251601996749,13cyclictest1-21systemd09:00:002
251595996627,34cyclictest16950irq/224-800000007:50:010
251595996324,3cyclictest0-21swapper/012:20:010
251595996320,9cyclictest235-21systemd-journal09:35:000
251595996215,13cyclictest272-21dbus-daemon07:25:010
251595996210,5cyclictest258426-21latency_hist09:20:020
251598996137,15cyclictest23-21ksoftirqd/111:05:021
25159599615,15cyclictest268664-21modprobe12:40:000
25159599612,20cyclictest262780-21grep10:45:010
251598996052,6cyclictest23-21ksoftirqd/107:40:011
25159599602,10cyclictest235-21systemd-journal10:40:000
25159599602,10cyclictest235-21systemd-journal10:40:000
251595996020,11cyclictest12-21ksoftirqd/012:21:340
25159599584,17cyclictest261455-21grep10:20:010
251595995824,4cyclictest262185-21latency_hist10:35:020
25159599581,27cyclictest0-21swapper/011:35:290
251605995736,16cyclictest1-21systemd07:35:013
251598995737,15cyclictest235-21systemd-journal09:30:001
251595995718,5cyclictest267012-21latency_hist12:05:020
251595995717,7cyclictest1-21systemd07:55:000
251598995635,16cyclictest1-21systemd12:10:001
251595995619,6cyclictest12-21ksoftirqd/008:15:010
251595995616,11cyclictest12-21ksoftirqd/008:05:020
25159599561,27cyclictest0-21swapper/012:11:080
25159899559,34cyclictest253591-21kworker/u8:307:55:011
251598995535,14cyclictest272-21dbus-daemon09:55:011
251595995524,13cyclictest12-21ksoftirqd/012:00:020
251595995519,13cyclictest261922-21sshd10:29:340
251595995517,7cyclictest258550-21sshd09:23:330
251595995421,10cyclictest12-21ksoftirqd/008:25:010
251595995418,8cyclictest12-21ksoftirqd/008:20:010
25159599541,4cyclictest253133-21latency_hist07:40:010
25160199538,10cyclictest0-21swapper/212:25:012
251601995340,9cyclictest48-21kcompactd011:08:182
251601995336,14cyclictest252000-21sshd07:15:332
251601995314,35cyclictest48-21kcompactd010:15:022
251598995343,7cyclictest23-21ksoftirqd/109:10:011
251595995319,8cyclictest264039-21latency_hist11:10:020
251595995314,10cyclictest272-21dbus-daemon07:15:010
251601995243,5cyclictest255162-21munin-run08:20:002
251601995233,15cyclictest255915-21sshd08:33:342
251601995231,15cyclictest1-21systemd11:45:002
251598995235,12cyclictest1-21systemd11:45:011
251598995210,5cyclictest131rcu_preempt12:20:011
25159599522,5cyclictest131rcu_preempt10:10:020
25159599521,27cyclictest0-21swapper/009:05:050
251601995144,4cyclictest265568-21munin-run11:40:002
251601995138,10cyclictest253058-21sshd07:39:332
251601995136,11cyclictest268435-21munin-run12:35:012
251601995136,11cyclictest258043-21munin-run09:15:012
251601995136,11cyclictest252822-21munin-run07:35:002
251601995135,12cyclictest256724-21munin-run08:50:002
25159599512,3cyclictest131rcu_preempt08:05:320
251601995037,9cyclictest48-21kcompactd011:53:142
251601995036,10cyclictest253316-21sshd07:40:332
251601995034,12cyclictest263202-21sshd10:53:332
251601995032,13cyclictest272-21dbus-daemon11:50:012
251601995032,13cyclictest272-21dbus-daemon11:50:012
251595995021,4cyclictest0-21swapper/011:17:440
251601994936,10cyclictest256955-21sshd08:53:332
251601994935,10cyclictest263769-21munin-run11:05:012
251601994935,10cyclictest260109-21munin-run09:55:012
251601994934,11cyclictest251766-21cron07:15:002
251601994934,10cyclictest255700-21munin-run08:30:012
251598994940,5cyclictest23-21ksoftirqd/111:40:001
251595994933,11cyclictest12-21ksoftirqd/009:45:000
251595994924,4cyclictest0-21swapper/008:45:420
25159599491,26cyclictest0-21swapper/009:00:230
251601994837,6cyclictest261937-21munin-run10:30:002
251601994835,9cyclictest48-21kcompactd009:34:322
251601994835,10cyclictest260867-21sshd10:07:332
251601994834,10cyclictest255402-21sshd08:20:482
251601994834,10cyclictest254151-21munin-run08:00:002
251601994834,10cyclictest252320-21munin-run07:25:002
251601994833,11cyclictest267378-21munin-run12:15:012
251601994832,11cyclictest267127-21munin-run12:10:002
251598994838,7cyclictest23-21ksoftirqd/109:15:001
251601994735,9cyclictest48-21kcompactd011:23:502
251601994735,9cyclictest254356-21sshd08:00:442
251601994734,9cyclictest268184-21munin-run12:30:012
251601994734,9cyclictest268184-21munin-run12:30:012
251601994734,9cyclictest256158-21sshd08:35:512
251601994734,10cyclictest267618-21sshd12:18:332
251601994734,10cyclictest261543-21cat10:20:032
251601994734,10cyclictest257482-21sshd09:02:332
251601994733,11cyclictest861385-21sendmail-mta09:05:202
251601994733,10cyclictest48-21kcompactd009:40:052
251601994733,10cyclictest262483-21munin-run10:40:012
251601994733,10cyclictest262483-21munin-run10:40:012
251601994733,10cyclictest260403-21munin-run10:00:012
251601994730,11cyclictest48-21kcompactd012:02:402
251601994719,23cyclictest254639-21latency_hist08:10:002
251598994737,6cyclictest23-21ksoftirqd/110:00:001
251598994735,9cyclictest23-21ksoftirqd/112:00:001
251598994735,7cyclictest306-21in:imuxsock12:05:001
251598994732,11cyclictest272-21dbus-daemon09:50:011
25159599471,4cyclictest0-21swapper/009:38:490
25159599471,25cyclictest0-21swapper/010:45:330
251605994631,8cyclictest306-21in:imuxsock10:50:003
251605994626,14cyclictest1-21systemd11:50:013
251605994626,14cyclictest1-21systemd11:50:013
251601994634,9cyclictest363-21snmpd10:44:342
251601994633,9cyclictest48-21kcompactd008:42:222
251601994633,10cyclictest265305-21munin-run11:35:012
251601994632,9cyclictest48-21kcompactd007:25:342
251601994629,13cyclictest363-21snmpd11:18:472
251598994632,11cyclictest1-21systemd12:30:011
251598994632,11cyclictest1-21systemd12:30:011
25159899462,5cyclictest131rcu_preempt12:25:021
251598994612,6cyclictest131rcu_preempt11:20:001
251598994612,6cyclictest131rcu_preempt08:15:001
251598994612,6cyclictest131rcu_preempt07:25:001
251601994534,8cyclictest259829-21sshd09:46:332
251601994533,9cyclictest363-21snmpd07:53:172
251601994532,9cyclictest48-21kcompactd009:16:472
251601994531,9cyclictest48-21kcompactd007:48:562
251601994531,9cyclictest363-21snmpd11:10:052
251601994531,11cyclictest261655-21sshd10:21:332
251601994531,11cyclictest261655-21sshd10:21:332
251601994531,11cyclictest254874-21sshd08:13:332
251601994528,13cyclictest363-21snmpd09:28:342
25159899455,10cyclictest23-21ksoftirqd/111:30:001
25159599451,4cyclictest0-21swapper/009:48:590
25159599451,25cyclictest0-21swapper/007:28:020
251605994429,12cyclictest37-21ksoftirqd/309:55:003
251601994432,9cyclictest48-21kcompactd012:38:102
251601994432,9cyclictest48-21kcompactd010:56:052
251601994432,9cyclictest262949-21sshd10:48:332
251601994431,8cyclictest48-21kcompactd011:59:532
251598994435,6cyclictest23-21ksoftirqd/109:20:011
251598994434,7cyclictest23-21ksoftirqd/107:50:011
251598994434,6cyclictest306-21in:imuxsock10:40:011
251598994434,6cyclictest306-21in:imuxsock10:40:011
25159899442,8cyclictest0-21swapper/110:50:001
251595994425,4cyclictest0-21swapper/010:58:520
25159599441,3cyclictest0-21swapper/010:21:150
25159599441,3cyclictest0-21swapper/010:21:150
251605994334,6cyclictest37-21ksoftirqd/307:50:023
251605994329,10cyclictest235-21systemd-journal10:55:003
251601994328,10cyclictest262176-21cron10:35:002
251598994335,6cyclictest221rcuc/107:15:021
251598994332,5cyclictest306-21in:imuxsock10:25:011
251598994332,5cyclictest306-21in:imuxsock10:25:011
251598994329,10cyclictest23-21ksoftirqd/108:00:011
251598994317,5cyclictest131rcu_preempt09:40:021
251598994313,9cyclictest131rcu_preempt10:30:001
251598994313,9cyclictest131rcu_preempt08:30:001
251595994324,14cyclictest272-21dbus-daemon08:30:010
25159599431,4cyclictest0-21swapper/011:21:530
25160599423,4cyclictest131rcu_preempt09:25:003
251601994226,10cyclictest265040-21cron11:30:002
25159899426,6cyclictest23-21ksoftirqd/112:35:001
25159899425,7cyclictest131rcu_preempt10:10:021
251595994228,11cyclictest265040-21cron11:30:000
25159599421,4cyclictest0-21swapper/010:50:410
25159599421,25cyclictest0-21swapper/008:57:270
251605994133,6cyclictest361rcuc/312:10:023
251605994130,8cyclictest268154-21sshd12:29:333
251605994130,8cyclictest268154-21sshd12:29:333
251605994124,13cyclictest235-21systemd-journal10:45:003
251605994123,14cyclictest235-21systemd-journal08:28:333
251605994123,12cyclictest1-21systemd11:35:013
251601994129,9cyclictest363-21snmpd09:21:282
251598994129,8cyclictest235-21systemd-journal08:05:001
251598994112,6cyclictest131rcu_preempt08:50:011
251595994124,13cyclictest268136-21sshd12:26:330
251595994124,13cyclictest268136-21sshd12:26:330
251605994025,11cyclictest37-21ksoftirqd/308:51:333
251605994025,10cyclictest235-21systemd-journal10:10:013
251601994026,10cyclictest363-21snmpd09:39:052
25159899406,6cyclictest131rcu_preempt12:40:011
251598994029,6cyclictest261394-21cron10:20:001
251598994028,7cyclictest306-21in:imuxsock11:25:001
251598994028,7cyclictest306-21in:imuxsock08:35:001
251598994025,11cyclictest23-21ksoftirqd/108:35:331
251598994023,12cyclictest1-21systemd07:30:011
251598994022,12cyclictest1-21systemd09:00:011
251598994020,14cyclictest272-21dbus-daemon11:50:011
251598994020,14cyclictest272-21dbus-daemon11:50:011
251595994031,6cyclictest265826-21cron11:45:000
251595994029,9cyclictest12-21ksoftirqd/008:35:020
251595994029,8cyclictest263738-21sshd11:04:340
25160599394,24cyclictest256181-21modprobe08:40:013
251605993925,10cyclictest1-21systemd10:25:013
251605993925,10cyclictest1-21systemd10:25:013
251605993924,9cyclictest235-21systemd-journal10:20:013
251605993923,10cyclictest272-21dbus-daemon08:10:013
251605993922,13cyclictest235-21systemd-journal09:25:023
251605993920,13cyclictest272-21dbus-daemon11:00:003
25159899396,11cyclictest23-21ksoftirqd/111:00:001
25159899395,6cyclictest131rcu_preempt08:20:001
251598993930,6cyclictest23-21ksoftirqd/112:15:011
251598993929,7cyclictest23-21ksoftirqd/108:55:001
25159899392,6cyclictest131rcu_preempt10:45:001
251598993925,11cyclictest23-21ksoftirqd/110:15:021
251598993925,10cyclictest306-21in:imuxsock07:42:331
251598993912,8cyclictest131rcu_preempt09:05:001
25159599399,25cyclictest12-21ksoftirqd/009:56:070
251595993933,3cyclictest16950irq/224-800000012:35:000
251595993923,12cyclictest1-21systemd10:15:010
25159599391,25cyclictest0-21swapper/010:03:090
251605993827,6cyclictest306-21in:imuxsock11:30:003
251605993826,9cyclictest264228-21sshd11:11:193
251605993825,7cyclictest306-21in:imuxsock07:20:013
251605993823,11cyclictest272-21dbus-daemon09:15:013
251605993823,11cyclictest253865-21systemd-run07:55:013
251605993820,13cyclictest272-21dbus-daemon10:00:013
251598993829,6cyclictest23-21ksoftirqd/107:35:011
251598993827,7cyclictest255405-21sshd08:21:341
251598993827,7cyclictest23-21ksoftirqd/110:35:011
25159599382,19cyclictest0-21swapper/007:10:020
25159599381,32cyclictest260084-21sshd09:52:330
25159599381,24cyclictest0-21swapper/007:32:240
25160599379,5cyclictest131rcu_preempt11:10:013
251605993730,4cyclictest261142-21munin-plugin-st10:15:013
251605993726,9cyclictest37-21ksoftirqd/309:05:023
251605993726,6cyclictest0-21swapper/308:50:003
251605993725,10cyclictest37-21ksoftirqd/310:05:013
251605993722,11cyclictest37-21ksoftirqd/312:15:023
251605993722,11cyclictest37-21ksoftirqd/307:40:023
251605993721,12cyclictest235-21systemd-journal08:35:003
251605993721,10cyclictest37-21ksoftirqd/309:45:003
25159899379,5cyclictest131rcu_preempt11:51:281
251598993729,5cyclictest252044-21sendmail07:20:011
251598993728,6cyclictest23-21ksoftirqd/109:31:331
251598993724,10cyclictest23-21ksoftirqd/110:00:041
251598993723,9cyclictest306-21in:imuxsock09:45:001
251598993722,9cyclictest306-21in:imuxsock08:45:001
251598993722,11cyclictest23-21ksoftirqd/108:10:011
251595993715,17cyclictest0-21swapper/011:50:030
251595993715,17cyclictest0-21swapper/011:50:020
25160599366,4cyclictest131rcu_preempt08:05:013
25160599366,3cyclictest131rcu_preempt09:10:013
25160599365,4cyclictest131rcu_preempt08:45:023
25160599364,20cyclictest266868-21modprobe12:05:003
25160599363,5cyclictest131rcu_preempt12:20:003
251605993628,5cyclictest0-21swapper/307:10:023
251605993627,5cyclictest412-21sshd07:20:343
25160599362,4cyclictest131rcu_preempt11:20:003
251605993624,9cyclictest37-21ksoftirqd/311:40:013
251605993621,8cyclictest235-21systemd-journal08:55:023
251605993621,10cyclictest267908-21modprobe12:25:003
25160599361,31cyclictest48-21kcompactd009:45:383
251598993626,7cyclictest265315-21systemctl11:35:011
251598993625,8cyclictest251604-21sed07:10:021
251598993624,8cyclictest306-21in:imuxsock11:10:031
251595993626,7cyclictest12-21ksoftirqd/011:55:020
251595993623,10cyclictest265404-21cat11:35:020
251605993525,8cyclictest37-21ksoftirqd/308:00:013
251605993524,8cyclictest259207-21cut09:35:023
251605993521,10cyclictest235-21systemd-journal10:28:333
251605993520,11cyclictest37-21ksoftirqd/311:25:023
251605993520,10cyclictest235-21systemd-journal08:20:003
251605993519,12cyclictest235-21systemd-journal10:39:333
251605993519,12cyclictest235-21systemd-journal10:39:333
251605993516,14cyclictest272-21dbus-daemon07:30:003
25159899359,5cyclictest131rcu_preempt11:10:011
25159899355,5cyclictest131rcu_preempt09:25:001
251598993526,5cyclictest263370-21latency_hist10:55:021
251595993525,8cyclictest12-21ksoftirqd/007:20:020
251595993523,9cyclictest12-21ksoftirqd/008:00:010
251595993523,8cyclictest16950irq/224-800000009:10:080
251605993425,7cyclictest37-21ksoftirqd/310:34:323
251605993423,9cyclictest37-21ksoftirqd/312:40:013
251605993423,8cyclictest306-21in:imuxsock07:10:343
251605993423,7cyclictest37-21ksoftirqd/308:25:023
251605993422,9cyclictest37-21ksoftirqd/308:15:013
25160599341,3cyclictest131rcu_preempt09:20:023
251601993417,12cyclictest30-21ksoftirqd/207:10:022
251595993426,6cyclictest0-21swapper/008:40:450
25159599341,29cyclictest0-21swapper/012:05:210
25159599341,29cyclictest0-21swapper/009:25:330
25159599341,29cyclictest0-21swapper/007:42:450
251605993324,5cyclictest268463-21latency_hist12:35:013
251605993324,5cyclictest260902-21kworker/3:111:45:013
251605993318,10cyclictest0-21swapper/311:05:013
25160599327,3cyclictest131rcu_preempt11:58:333
251605993225,5cyclictest252852-21kworker/3:007:35:373
251605993220,6cyclictest271-21cron09:40:003
251605993123,5cyclictest266397-21latency_hist11:55:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional