You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-22 - 05:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackeslot3s.osadl.org (updated Mon Jun 22, 2026 00:45:25)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28982099863,20cyclictest326377-21sendmail-msp22:20:010
28982099863,20cyclictest326377-21sendmail-msp22:20:010
289820998621,13cyclictest366519-21ssh23:50:540
289820998416,6cyclictest16850irq/134-800000000:05:170
289820998229,46cyclictest0-21swapper/023:15:020
289829997911,3cyclictest131rcu_preempt20:35:022
28982099791,39cyclictest311415-21ssh21:45:320
289834997623,14cyclictest357828-21ssh23:31:013
289820997620,12cyclictest307938-21ssh21:37:470
289829997531,39cyclictest3467602-21systemd-journal00:00:002
289829997435,36cyclictest30-21ksoftirqd/223:20:022
28982099744,65cyclictest344166-21latency_hist23:00:020
289820997417,47cyclictest16850irq/134-800000023:16:030
28982099739,15cyclictest363724-21modprobe23:45:000
289820997329,40cyclictest304698-21sed21:30:020
289820997327,16cyclictest380837-21sshd00:23:300
289820997327,16cyclictest380837-21sshd00:23:300
28982099732,6cyclictest1-21systemd21:20:010
289820997311,15cyclictest385795-21modprobe00:35:000
289820997135,33cyclictest16950irq/224-800000000:18:020
289820997129,38cyclictest319862-21latency_hist22:05:020
289820997115,48cyclictest16850irq/134-800000000:12:590
289820997110,5cyclictest16850irq/134-800000023:55:360
289834996919,14cyclictest382774-21ssh00:27:543
28982599692,15cyclictest343281-21ssh22:58:231
289820996928,6cyclictest331541-21sh22:31:290
289829996823,41cyclictest357443-21ssh23:30:102
28982599682,13cyclictest380608-21ssh00:22:591
28982599682,13cyclictest380608-21ssh00:22:581
28982099685,18cyclictest388017-21munin-run00:40:000
289820996826,13cyclictest334163-21ssh22:37:380
289820996826,13cyclictest334163-21ssh22:37:380
289820996825,12cyclictest346081-21ssh23:04:530
28982099682,29cyclictest339645-21latency_hist22:50:020
28982099681,28cyclictest0-21swapper/021:22:470
28982999679,4cyclictest131rcu_preempt19:55:022
28982999675,56cyclictest315591-21ls21:55:032
28982999672,15cyclictest345899-21ssh23:04:152
28982999672,15cyclictest310388-21ssh21:43:332
289825996727,36cyclictest298418-21sh21:15:071
28982599672,14cyclictest306196-21ssh21:33:301
289825996716,47cyclictest210-21jbd2/mmcblk1p2-21:50:031
28982099676,12cyclictest292352-21modprobe20:00:010
28982099676,12cyclictest292352-21modprobe20:00:000
289820996716,14cyclictest3467602-21systemd-journal23:25:010
28982099671,4cyclictest304957-21ssh21:30:170
289829996632,29cyclictest296051-21diskmemload22:11:212
289829996630,31cyclictest290793-21sshd19:28:252
289825996627,34cyclictest296175-21date21:10:031
28982599662,14cyclictest321742-21ssh22:09:281
289825996621,41cyclictest23-21ksoftirqd/121:47:141
28982599661,14cyclictest387251-21ssh00:38:111
28982599661,14cyclictest351210-21ssh23:16:011
28982599661,13cyclictest346737-21ssh23:05:501
28982599661,13cyclictest346737-21ssh23:05:501
28982599661,13cyclictest303112-21ssh21:25:531
289820996614,42cyclictest16850irq/134-800000022:41:090
289829996524,36cyclictest275-21dbus-daemon21:25:012
289829996522,39cyclictest340068-21sh22:50:432
28982999652,16cyclictest326358-21munin-run22:20:012
28982999652,16cyclictest326358-21munin-run22:20:002
28982599652,15cyclictest326979-21ssh22:21:031
28982599652,14cyclictest318776-21ssh22:02:281
28982599652,13cyclictest355744-21ssh23:26:251
28982599652,12cyclictest374568-21ssh00:09:241
28982599651,15cyclictest349585-21ssh23:12:291
28982599651,14cyclictest368594-21ssh23:55:381
28982599651,14cyclictest341682-21ssh22:54:531
28982599651,14cyclictest334872-21ssh22:39:221
28982599651,14cyclictest334872-21ssh22:39:211
28982599651,13cyclictest372327-21ssh00:04:191
28982599651,13cyclictest297229-21ssh21:12:341
28982099656,13cyclictest294953-21modprobe20:50:010
28982099655,12cyclictest3467602-21systemd-journal23:35:000
28982099654,22cyclictest361497-21sendmail23:40:010
28982099654,19cyclictest296093-21latency_hist21:10:010
289820996526,11cyclictest323218-21rm22:12:430
28983499649,23cyclictest380925-21ssh00:23:483
28983499649,23cyclictest380925-21ssh00:23:483
289829996429,31cyclictest342251-21sh22:55:402
28982999642,19cyclictest306112-21ssh21:33:192
289825996424,35cyclictest275-21dbus-daemon20:25:001
28982599641,8cyclictest375425-21sshd00:11:001
28982599641,14cyclictest359083-21ssh23:34:161
28982599641,14cyclictest345462-21ssh23:03:161
28982599641,14cyclictest306923-21ssh21:35:091
28982599641,14cyclictest300795-21ssh21:20:341
28982599641,13cyclictest367388-21ssh23:53:011
28982599641,13cyclictest338153-21ssh22:46:291
28982599641,12cyclictest383410-21ssh00:29:361
28982099645,19cyclictest315437-21cut21:55:010
28982099645,15cyclictest293391-21modprobe20:19:590
28982099643,6cyclictest320558-21sshd22:06:250
289820996426,20cyclictest0-21swapper/023:26:460
28982099642,57cyclictest329261-21ssh22:26:190
289820996425,6cyclictest317690-21latency_hist22:00:020
289834996322,14cyclictest364-21snmpd21:47:523
28982999632,13cyclictest363725-21modprobe23:45:002
28982599632,14cyclictest330566-21ssh22:29:381
28982599632,13cyclictest361982-21ssh23:40:351
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional