You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-10 - 17:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot3s.osadl.org (updated Wed Jun 10, 2026 12:45:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
855420991234,115cyclictest0-21swapper/008:45:030
85542099112102,8cyclictest12-21ksoftirqd/011:35:030
855420999888,7cyclictest12-21ksoftirqd/008:10:010
855425997520,14cyclictest1-21systemd12:05:001
855425997418,21cyclictest901512-21ssh10:38:591
855425997417,16cyclictest926236-21ssh11:34:021
85543599731,67cyclictest861607-21diskmemload09:35:033
85543599731,67cyclictest861607-21diskmemload09:35:023
855425997218,15cyclictest952690-21ssh12:32:461
855425997218,15cyclictest952690-21ssh12:32:451
855435996913,13cyclictest275-21dbus-daemon07:55:013
855430996910,35cyclictest875927-21kworker/u8:310:25:022
855425996920,15cyclictest930440-21ssh11:43:211
855425996917,13cyclictest903921-21ssh10:44:211
855435996829,35cyclictest944591-21munin-plugin-st12:15:013
855435996829,32cyclictest860323-21cut08:45:013
855425996821,15cyclictest892207-21ssh10:18:001
855425996821,15cyclictest892207-21ssh10:18:001
855425996820,14cyclictest860828-21modprobe08:55:001
855425996819,15cyclictest918730-21ssh11:17:181
855425996816,20cyclictest863790-21ssh09:14:451
855420996854,11cyclictest275-21dbus-daemon12:30:010
855420996825,9cyclictest12-21ksoftirqd/009:20:410
855420996825,9cyclictest12-21ksoftirqd/009:20:410
855425996715,15cyclictest895598-21ssh10:25:061
855425996715,15cyclictest895598-21ssh10:25:061
855435996625,8cyclictest906569-21sed10:50:023
855435996617,12cyclictest275-21dbus-daemon09:45:023
85543599661,6cyclictest131rcu_preempt09:39:593
855425996617,15cyclictest873388-21ssh09:35:381
855425996616,15cyclictest928846-21munin-run11:40:011
855425996516,14cyclictest885830-21ssh10:03:471
855425996515,15cyclictest906877-21ssh10:50:301
85543599644,52cyclictest858472-21kworker/u8:308:15:023
85543599641,25cyclictest926804-21wc11:35:023
855425996417,13cyclictest895036-21ssh10:24:211
855420996422,36cyclictest875175-21sendmail09:39:590
855420996416,29cyclictest940921-21ssh12:06:290
855435996322,4cyclictest879817-21latency_hist09:50:023
855425996316,15cyclictest917333-21ssh11:14:211
855425996316,15cyclictest855621-21munin-run07:15:001
85542099633,9cyclictest121ksoftirqd/012:38:030
855435996222,10cyclictest37-21ksoftirqd/307:20:023
855435996221,5cyclictest919078-21sh11:18:053
855425996222,7cyclictest943194-21ssh12:11:351
855425996221,8cyclictest941190-21ssh12:07:051
855425996221,10cyclictest899023-21ssh10:33:101
855425996215,16cyclictest949660-21ssh12:25:471
855425996214,15cyclictest946428-21ssh12:18:541
85542099627,7cyclictest12-21ksoftirqd/012:14:030
855435996122,10cyclictest37-21ksoftirqd/311:54:523
855435996118,11cyclictest37-21ksoftirqd/307:50:023
855435996110,16cyclictest884821-1kworker/u9:110:29:593
855435996110,16cyclictest884821-1kworker/u9:110:29:583
855425996139,17cyclictest867403-21ssh09:22:321
855425996139,17cyclictest867403-21ssh09:22:311
855425996117,14cyclictest921437-21ssh11:23:151
855425996115,16cyclictest864214-21ssh09:15:181
85542099613,9cyclictest121ksoftirqd/009:35:000
85542099613,9cyclictest121ksoftirqd/009:35:000
85542099611,6cyclictest0-21swapper/011:07:250
85543599602,19cyclictest857969-21sendmail08:00:003
855435996019,12cyclictest37-21ksoftirqd/311:45:523
85542099602,7cyclictest121ksoftirqd/010:16:560
85542099602,7cyclictest121ksoftirqd/010:16:550
855435995939,15cyclictest1-21systemd12:05:003
855435995926,9cyclictest37-21ksoftirqd/310:59:533
855435995924,32cyclictest37-21ksoftirqd/309:00:023
855435995920,7cyclictest37-21ksoftirqd/311:57:513
855425995937,18cyclictest931656-21ssh11:45:381
855425995936,19cyclictest905181-21ssh10:46:531
855425995936,17cyclictest889061-21ssh10:10:431
855425995915,14cyclictest883454-21ssh09:58:291
855420995922,33cyclictest12-21ksoftirqd/009:44:160
855435995825,4cyclictest894331-21sh10:22:363
855435995823,10cyclictest37-21ksoftirqd/309:05:013
855430995848,6cyclictest849075-21kworker/2:010:15:352
855430995848,6cyclictest849075-21kworker/2:010:15:342
855425995837,17cyclictest947144-21ssh12:20:081
855425995837,17cyclictest947144-21ssh12:20:071
855420995851,3cyclictest0-21swapper/007:55:020
855420995825,16cyclictest904016-21ssh10:44:340
855420995818,9cyclictest12-21ksoftirqd/011:01:500
855435995724,5cyclictest884190-21latency_hist10:00:013
855435995720,9cyclictest37-21ksoftirqd/309:25:023
855435995720,9cyclictest37-21ksoftirqd/309:25:023
855425995745,9cyclictest955721-21ssh12:39:461
855425995745,9cyclictest877783-21ssh09:45:201
855425995741,13cyclictest922831-21ssh11:26:091
855425995739,14cyclictest914966-21ssh11:09:021
855425995735,18cyclictest912304-21ssh11:02:581
855425995714,15cyclictest861607-21diskmemload09:44:271
855425995714,14cyclictest936420-21ssh11:56:281
85542099579,24cyclictest16950irq/224-800000010:10:020
855420995720,32cyclictest16850irq/134-800000009:16:270
855435995628,26cyclictest37-21ksoftirqd/311:36:403
855435995623,4cyclictest885220-21sh10:02:143
855435995623,11cyclictest37-21ksoftirqd/310:39:073
855435995622,6cyclictest861607-21diskmemload10:51:113
855435995621,5cyclictest950480-21sh12:27:493
855425995635,17cyclictest909665-21ssh10:56:571
855425995635,17cyclictest868732-21ssh09:25:161
855425995634,18cyclictest364-21snmpd08:24:041
855420995650,2cyclictest0-21swapper/010:55:020
855420995612,14cyclictest12-21ksoftirqd/010:50:010
855435995526,5cyclictest869084-21sh09:26:033
855435995523,11cyclictest37-21ksoftirqd/310:10:033
85543599552,20cyclictest864245-21ssh09:15:233
855435995521,7cyclictest37-21ksoftirqd/309:11:173
85543599551,29cyclictest37-21ksoftirqd/310:41:093
855430995545,6cyclictest849075-21kworker/2:011:22:332
855430995545,6cyclictest849075-21kworker/2:010:46:012
855425995537,15cyclictest934708-21ssh11:52:431
855425995536,15cyclictest879975-21ssh09:50:181
855425995536,15cyclictest856892-21sshd07:38:341
855425995533,18cyclictest871202-21ssh09:30:471
855425995533,18cyclictest871202-21ssh09:30:461
855420995531,9cyclictest12-21ksoftirqd/011:51:250
855420995527,13cyclictest878353-21ssh09:46:510
855420995514,14cyclictest12-21ksoftirqd/011:37:240
855435995438,11cyclictest275-21dbus-daemon11:15:003
855435995422,10cyclictest37-21ksoftirqd/311:24:333
855435995419,5cyclictest861607-21diskmemload11:05:053
855430995448,3cyclictest866176-21kworker/2:109:34:512
855430995448,3cyclictest866176-21kworker/2:109:34:512
855430995442,8cyclictest866176-21kworker/2:109:35:572
855430995437,13cyclictest1-21systemd08:45:012
855425995439,12cyclictest886788-21ssh10:05:341
855425995434,16cyclictest364-21snmpd07:40:171
855425995432,18cyclictest861085-21munin-run09:00:021
85542099546,8cyclictest12-21ksoftirqd/012:17:070
85542099546,6cyclictest121ksoftirqd/010:35:090
85542099546,4cyclictest131rcu_preempt09:27:520
85542099546,12cyclictest12-21ksoftirqd/011:18:110
85542099545,6cyclictest121ksoftirqd/010:20:420
855420995438,12cyclictest1-21systemd08:30:010
855420995438,12cyclictest1-21systemd08:30:010
855420995433,17cyclictest16850irq/134-800000011:41:090
855435995319,7cyclictest37-21ksoftirqd/311:01:203
855430995343,6cyclictest849075-21kworker/2:011:34:042
855430995334,11cyclictest861086-21grep09:00:002
855425995340,10cyclictest857422-21sshd07:48:341
855425995338,11cyclictest856126-21sshd07:20:341
855425995331,17cyclictest860307-21cron08:45:001
85542099537,9cyclictest12-21ksoftirqd/010:32:150
855435995224,14cyclictest37-21ksoftirqd/311:29:123
855435995222,5cyclictest929144-21sh11:40:103
855435995219,7cyclictest37-21ksoftirqd/312:22:543
855435995219,7cyclictest37-21ksoftirqd/312:22:533
855430995244,5cyclictest849075-21kworker/2:009:21:062
855430995244,5cyclictest849075-21kworker/2:009:21:062
855430995242,5cyclictest849075-21kworker/2:011:43:252
855430995232,15cyclictest1-21systemd11:50:002
855425995238,11cyclictest858966-21cron08:17:001
855425995232,16cyclictest364-21snmpd08:29:151
855425995232,16cyclictest364-21snmpd08:29:151
85542099522,46cyclictest0-21swapper/011:25:020
85542099521,13cyclictest12-21ksoftirqd/007:45:020
855420995211,37cyclictest12-21ksoftirqd/010:00:040
855435995123,8cyclictest37-21ksoftirqd/310:09:433
855435995119,10cyclictest37-21ksoftirqd/310:16:113
855435995119,10cyclictest37-21ksoftirqd/310:16:103
855435995118,9cyclictest37-21ksoftirqd/309:53:063
855435995114,13cyclictest3467718-21lldpd08:50:013
855425995138,10cyclictest860574-21munin-run08:50:001
855425995131,15cyclictest3467602-21systemd-journal08:00:001
855425995129,18cyclictest364-21snmpd08:14:541
855420995116,30cyclictest16850irq/134-800000012:34:040
855420995116,30cyclictest16850irq/134-800000012:34:040
855435995021,5cyclictest945433-21sh12:16:363
855430995042,5cyclictest919912-21kworker/2:212:30:232
855430995042,5cyclictest919912-21kworker/2:212:30:232
855430995042,5cyclictest919912-21kworker/2:212:26:302
855430995042,5cyclictest919912-21kworker/2:212:12:352
855430995042,5cyclictest866176-21kworker/2:109:26:322
855430995042,5cyclictest849075-21kworker/2:007:13:342
855430995041,6cyclictest849075-21kworker/2:011:17:592
855430995041,5cyclictest919912-21kworker/2:212:40:012
855430995041,5cyclictest866176-21kworker/2:109:45:012
855430995041,5cyclictest849075-21kworker/2:011:27:052
855425995037,10cyclictest861588-21sshd09:09:341
855425995036,11cyclictest858217-21sshd08:04:331
85542099508,7cyclictest12-21ksoftirqd/012:00:020
85542099506,8cyclictest12-21ksoftirqd/009:56:510
85542099505,7cyclictest12-21ksoftirqd/009:13:170
855420995033,7cyclictest12-21ksoftirqd/010:26:250
855420995033,7cyclictest12-21ksoftirqd/010:26:250
855420995030,17cyclictest16850irq/134-800000010:55:030
855430994941,5cyclictest866176-21kworker/2:111:02:272
855430994940,6cyclictest866176-21kworker/2:111:07:092
855430994940,6cyclictest849075-21kworker/2:011:36:122
855430994940,6cyclictest833260-21kworker/2:207:45:012
855430994939,5cyclictest849075-21kworker/2:012:00:142
855430994934,10cyclictest3467602-21systemd-journal11:50:342
855425994934,11cyclictest3467602-21systemd-journal07:15:131
855425994930,15cyclictest364-21snmpd07:52:081
85542099493,7cyclictest121ksoftirqd/009:54:160
85542099493,11cyclictest12-21ksoftirqd/011:13:330
855420994914,19cyclictest16850irq/134-800000012:21:560
855420994914,19cyclictest16850irq/134-800000012:21:550
855435994815,11cyclictest275-21dbus-daemon08:25:003
855430994840,5cyclictest919912-21kworker/2:212:09:592
855430994840,5cyclictest849075-21kworker/2:010:51:512
855430994838,6cyclictest849075-21kworker/2:010:40:012
855430994837,7cyclictest919912-21kworker/2:211:58:112
855430994824,15cyclictest0-21swapper/209:20:012
85542099483,15cyclictest12-21ksoftirqd/012:00:580
85542099482,41cyclictest889894-21ssh10:12:500
85542099481,15cyclictest12-21ksoftirqd/011:30:010
855435994731,12cyclictest37-21ksoftirqd/307:15:003
855435994722,10cyclictest37-21ksoftirqd/307:30:023
855435994719,8cyclictest37-21ksoftirqd/312:06:303
855430994739,5cyclictest866176-21kworker/2:109:49:332
855430994738,6cyclictest849075-21kworker/2:011:12:352
855430994737,5cyclictest849075-21kworker/2:010:10:382
855430994735,8cyclictest833260-21kworker/2:207:35:002
855430994730,13cyclictest1-21systemd07:30:012
855425994740,4cyclictest861368-21munin-run09:05:011
855425994734,10cyclictest858461-21sshd08:07:351
855425994732,10cyclictest48-21kcompactd008:33:301
855425994730,13cyclictest364-21snmpd07:34:161
855420994739,5cyclictest151rcuc/008:20:000
855420994732,12cyclictest861596-21cron09:10:000
85542099471,9cyclictest12-21ksoftirqd/011:48:380
855430994639,5cyclictest849075-21kworker/2:009:53:182
855430994638,5cyclictest919912-21kworker/2:212:20:362
855430994638,5cyclictest919912-21kworker/2:212:20:362
855430994638,5cyclictest849075-21kworker/2:008:15:022
855430994633,8cyclictest309-21in:imuxsock08:30:022
855430994633,8cyclictest309-21in:imuxsock08:30:012
855430994627,14cyclictest3467602-21systemd-journal08:30:022
855425994629,13cyclictest364-21snmpd07:25:201
855420994635,8cyclictest12-21ksoftirqd/007:25:000
855420994634,8cyclictest19350irq/34-mmc107:40:010
85542099462,11cyclictest3587003-1kworker/0:0H07:35:020
855430994537,6cyclictest849075-21kworker/2:010:34:492
855430994537,5cyclictest866176-21kworker/2:110:29:402
855430994537,5cyclictest866176-21kworker/2:110:29:392
855430994537,5cyclictest849075-21kworker/2:010:44:442
855430994535,7cyclictest30-21ksoftirqd/211:00:022
855420994516,25cyclictest859785-21latency_hist08:35:010
855435994419,5cyclictest37-21ksoftirqd/308:05:023
855430994435,6cyclictest919912-21kworker/2:212:19:032
855430994435,6cyclictest833260-21kworker/2:207:53:202
855430994429,11cyclictest275-21dbus-daemon08:25:002
855430994428,12cyclictest30-21ksoftirqd/208:50:002
85542099443,6cyclictest12-21ksoftirqd/008:25:010
855435994333,5cyclictest856919-21sendmail07:40:003
855430994336,5cyclictest849075-21kworker/2:010:02:262
855430994334,6cyclictest849075-21kworker/2:009:57:002
855430994330,10cyclictest30-21ksoftirqd/208:10:022
855430994327,11cyclictest857954-21cron08:00:002
855425994331,9cyclictest364-21snmpd08:37:361
855420994336,4cyclictest16950irq/224-800000007:30:010
855420994332,8cyclictest12-21ksoftirqd/008:15:010
855420994322,13cyclictest12-21ksoftirqd/009:00:000
855420994315,25cyclictest151rcuc/007:53:570
85542099431,11cyclictest12-21ksoftirqd/007:50:020
855430994234,5cyclictest849075-21kworker/2:009:12:152
855430994229,9cyclictest274-21cron08:19:592
855430994227,11cyclictest3467602-21systemd-journal08:55:002
855430994223,11cyclictest275-21dbus-daemon08:40:022
85542099426,24cyclictest19350irq/34-mmc107:10:020
855435994131,6cyclictest856157-21sh07:25:003
855430994129,9cyclictest1-21systemd07:50:012
855430994128,8cyclictest888543-21rm10:10:002
855430994120,16cyclictest275-21dbus-daemon07:40:002
85542099416,6cyclictest12-21ksoftirqd/007:10:020
855420994127,10cyclictest860806-21sshd08:54:350
85543599405,30cyclictest955827-21modprobe12:39:593
855435994028,10cyclictest37-21ksoftirqd/312:35:013
855435994028,10cyclictest37-21ksoftirqd/312:35:013
855430993920,15cyclictest3467602-21systemd-journal07:15:022
855425993924,10cyclictest855427-21cat07:10:011
855420993827,8cyclictest12-21ksoftirqd/008:40:020
855420993821,12cyclictest1-21systemd08:05:020
85543599373,7cyclictest856664-21munin-run07:35:003
855435993727,7cyclictest858859-21sed08:15:023
855435993727,6cyclictest309-21in:imuxsock08:35:023
855435993726,8cyclictest37-21ksoftirqd/308:30:013
855435993726,8cyclictest37-21ksoftirqd/308:30:003
85543099376,8cyclictest30-21ksoftirqd/209:08:342
855430993726,7cyclictest858254-21latency_hist08:05:022
855435993625,8cyclictest857163-21sshd07:41:343
855420993627,5cyclictest1-21systemd07:20:010
855435993528,4cyclictest861832-21latency_hist09:10:043
855435993527,5cyclictest859930-21latency_hist08:35:013
85543099351,4cyclictest131rcu_preempt07:25:022
855420993512,16cyclictest275-21dbus-daemon08:45:010
85543599336,5cyclictest131rcu_preempt10:30:123
855435993323,8cyclictest37-21ksoftirqd/308:07:343
855430993322,8cyclictest861338-21sshd09:04:342
85542099331,28cyclictest12-21ksoftirqd/009:02:190
85543599303,4cyclictest131rcu_preempt08:53:343
855435992815,10cyclictest855485-21cut07:10:013
855430992716,5cyclictest855506-21latency_hist07:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional