You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-30 - 04:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Mon Mar 30, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24971997523,46cyclictest14563-21sendmail_mailtr20:10:051
193302750,3sleep10-21swapper/120:18:541
193512654,13sleep20-21swapper/222:41:002
2497299645,50cyclictest0-21swapper/221:49:452
2497199644,29cyclictest0-21swapper/120:54:541
2497199644,29cyclictest0-21swapper/120:54:541
248599640,7rtkit-daemon0-21swapper/020:19:561
2496499633,52cyclictest0-21swapper/020:29:460
73982627,47sleep00-21swapper/019:59:590
2497299625,48cyclictest9579-21users20:50:082
248599620,7rtkit-daemon0-21swapper/017:29:481
248599620,7rtkit-daemon0-21swapper/017:29:481
2497299615,16cyclictest0-21swapper/219:54:562
2497299614,50cyclictest0-21swapper/220:32:112
248599610,7rtkit-daemon0-21swapper/019:11:071
248599610,5rtkit-daemon2484-21rtkit-daemon22:33:143
228762614,12sleep20-21swapper/222:46:362
166132614,12sleep30-21swapper/322:38:193
2497299603,51cyclictest0-21swapper/221:58:552
24973995929,13cyclictest0-21swapper/320:30:063
24972995928,11cyclictest0-21swapper/222:50:272
2497199595,27cyclictest0-21swapper/119:34:561
2497199595,27cyclictest0-21swapper/119:34:561
2497199594,27cyclictest0-21swapper/122:44:571
24971995921,11cyclictest0-21swapper/121:34:471
24971995921,11cyclictest0-21swapper/121:34:471
248599590,6rtkit-daemon0-21swapper/020:07:041
286052583,48sleep00-21swapper/022:54:560
2497299585,47cyclictest0-21swapper/220:01:222
2497199586,12cyclictest2513-21udisks-daemon22:09:531
24971995833,11cyclictest0-21swapper/122:25:071
2497199583,40cyclictest0-21swapper/119:33:201
236212584,46sleep30-21swapper/319:36:203
236212584,46sleep30-21swapper/319:36:203
24973995729,13cyclictest0-21swapper/321:39:543
24973995729,13cyclictest0-21swapper/321:39:543
2497299574,11cyclictest351-21munin-node19:49:582
24972995724,27cyclictest31423-21basename21:24:442
2497299572,48cyclictest0-21swapper/221:44:432
2497199575,36cyclictest0-21swapper/122:30:271
2497199574,37cyclictest0-21swapper/121:47:521
2497199574,26cyclictest0-21swapper/121:53:251
55152563,45sleep30-21swapper/319:57:363
45582563,46sleep10-21swapper/117:54:141
24973995634,9cyclictest27613-21kworker/3:221:46:423
2497299565,44cyclictest0-21swapper/222:24:492
2497299564,14cyclictest0-21swapper/221:34:532
2497299564,14cyclictest0-21swapper/221:34:532
24972995619,31cyclictest21761-21grep19:34:522
24972995619,31cyclictest21761-21grep19:34:522
2497199565,13cyclictest23175-21taskset21:10:331
2497199564,36cyclictest0-21swapper/121:23:311
24964995631,18cyclictest12950-21grep20:55:140
24964995631,18cyclictest12950-21grep20:55:140
2496499563,37cyclictest0-21swapper/020:35:020
24964995617,24cyclictest28722-21munin-node18:44:580
248599560,5rtkit-daemon31354-21ssh19:49:051
248599560,18rtkit-daemon2484-21rtkit-daemon22:16:373
61272554,13sleep20-21swapper/217:55:082
310092553,46sleep00-21swapper/019:47:580
24973995512,34cyclictest0-21swapper/321:09:483
2497199555,29cyclictest25557-21fschecks_count19:39:531
2497199554,35cyclictest0-21swapper/121:02:561
2497199554,14cyclictest0-21swapper/120:03:581
24971995528,9cyclictest121850irq/46-eth021:39:551
24971995528,9cyclictest121850irq/46-eth021:39:551
24971995524,12cyclictest0-21swapper/122:04:541
24971995523,19cyclictest0-21swapper/120:42:201
24971995511,24cyclictest0-21swapper/122:19:411
24971995511,24cyclictest0-21swapper/122:19:411
2496499553,28cyclictest0-21swapper/021:54:540
248599550,5rtkit-daemon2484-21rtkit-daemon20:39:333
248599550,4rtkit-daemon2484-21rtkit-daemon22:22:443
248599550,4rtkit-daemon2484-21rtkit-daemon22:22:443
248599550,35rtkit-daemon31945-21runrttasks17:42:331
43562543,44sleep00-21swapper/020:44:450
2497299549,24cyclictest4618-21ssh22:19:482
2497299549,24cyclictest4618-21ssh22:19:482
2497299545,43cyclictest0-21swapper/220:13:362
2497199544,33cyclictest0-21swapper/120:37:211
24971995422,13cyclictest0-21swapper/122:34:551
24971995421,13cyclictest0-21swapper/122:54:531
24971995415,24cyclictest0-21swapper/121:16:481
2496499544,46cyclictest0-21swapper/022:43:280
24964995411,25cyclictest0-21swapper/020:40:020
248599540,6rtkit-daemon2484-21rtkit-daemon21:29:463
248599540,5rtkit-daemon2484-21rtkit-daemon20:39:483
118722543,44sleep20-21swapper/221:43:242
118722543,44sleep20-21swapper/221:43:242
286992532,9sleep20-21swapper/221:19:502
269402530,6sleep226939-21cat22:04:512
25382536,41sleep10-21swapper/122:16:041
24973995326,12cyclictest0-21swapper/322:47:073
24973995326,12cyclictest0-21swapper/321:51:083
24973995326,12cyclictest0-21swapper/318:19:403
2497299534,43cyclictest0-21swapper/222:13:472
24972995336,9cyclictest29315-21grep17:35:142
2497199535,29cyclictest0-21swapper/121:29:471
2497199535,29cyclictest0-21swapper/120:49:491
2497199535,27cyclictest28407-21users20:30:091
2497199535,27cyclictest18741-21hddtemp_smartct21:04:541
2497199535,14cyclictest0-21swapper/119:20:111
2497199534,30cyclictest0-21swapper/121:54:551
2497199534,28cyclictest1287-21snmpd18:54:571
2497199534,28cyclictest1287-21snmpd18:54:571
2497199534,28cyclictest0-21swapper/119:24:551
24971995322,13cyclictest0-21swapper/120:27:081
24971995320,13cyclictest0-21swapper/117:55:111
2496499534,36cyclictest0-21swapper/022:32:280
2496499534,31cyclictest0-21swapper/019:39:590
2496499533,9cyclictest7032-21awk21:34:580
2496499533,9cyclictest7032-21awk21:34:580
2496499533,37cyclictest0-21swapper/019:21:280
24964995324,13cyclictest0-21swapper/022:04:570
248599530,6rtkit-daemon2484-21rtkit-daemon20:26:493
248599530,5rtkit-daemon2484-21rtkit-daemon22:13:443
248599530,5rtkit-daemon2484-21rtkit-daemon21:35:233
248599530,5rtkit-daemon2484-21rtkit-daemon21:35:233
237852534,40sleep00-21swapper/017:25:010
157092533,41sleep20-21swapper/219:24:512
64812523,43sleep10-21swapper/120:46:031
320702524,40sleep20-21swapper/218:50:012
258992523,6sleep025903-21ssh20:28:130
24973995232,7cyclictest8300-21load22:24:543
24973995231,8cyclictest26738-21perl22:04:493
24973995226,12cyclictest0-21swapper/321:00:013
2497299525,30cyclictest0-21swapper/220:46:342
2497299525,27cyclictest0-21swapper/222:35:442
2497299524,14cyclictest0-21swapper/220:14:522
2497299523,44cyclictest0-21swapper/221:29:502
2497299522,44cyclictest0-21swapper/220:24:452
2497199525,28cyclictest1419-21runrttasks22:49:571
2497199525,28cyclictest0-21swapper/121:24:531
2497199525,27cyclictest0-21swapper/122:39:531
2497199525,27cyclictest0-21swapper/118:49:521
2497199524,29cyclictest0-21swapper/118:09:591
2497199524,29cyclictest0-21swapper/118:09:591
24971995223,9cyclictest24869-21hwlatdetect18:35:001
2496499524,41cyclictest0-21swapper/021:49:570
24964995214,26cyclictest0-21swapper/019:15:020
24964995210,25cyclictest0-21swapper/022:34:560
248599520,5rtkit-daemon2484-21rtkit-daemon21:55:303
115282523,43sleep10-21swapper/118:06:481
65802512,43sleep00-21swapper/022:23:280
65802512,43sleep00-21swapper/022:23:280
299622514,41sleep30-21swapper/322:57:573
287002513,42sleep328772-21df_abs19:44:553
268712513,41sleep00-21swapper/022:53:550
24973995125,12cyclictest0-21swapper/318:49:503
24973995122,12cyclictest0-21swapper/321:05:463
24973995117,28cyclictest18457-21needreboot22:39:543
2497299515,40cyclictest0-21swapper/221:13:372
2497299515,40cyclictest0-21swapper/221:09:342
2497299514,42cyclictest0-21swapper/220:38:322
2497299514,18cyclictest0-21swapper/219:44:512
2497299513,41cyclictest0-21swapper/222:15:022
24972995125,8cyclictest20372-21df_inode20:19:502
24972995112,32cyclictest0-21swapper/219:39:502
2497199515,27cyclictest0-21swapper/119:54:401
2497199515,27cyclictest0-21swapper/118:41:211
2497199515,25cyclictest0-21swapper/122:00:501
2497199514,28cyclictest0-21swapper/118:34:391
24971995120,13cyclictest0-21swapper/119:50:001
2496499517,26cyclictest0-21swapper/021:59:490
2496499513,42cyclictest0-21swapper/020:52:110
2496499513,42cyclictest0-21swapper/019:52:060
24964995113,22cyclictest0-21swapper/021:20:040
248599510,5rtkit-daemon2484-21rtkit-daemon21:24:313
213062513,9sleep10-21swapper/118:29:281
212362512,9sleep30-21swapper/318:28:343
198812512,9sleep20-21swapper/219:30:352
149062513,42sleep114951-21diskstats18:14:541
12502512,9sleep30-21swapper/321:27:003
82332502,9sleep20-21swapper/218:00:042
52682503,42sleep00-21swapper/019:56:410
285462503,40sleep00-21swapper/017:35:030
2497399505,38cyclictest27027-21ssh19:41:133
24973995029,8cyclictest24799-21ssh22:49:493
2497399502,42cyclictest0-21swapper/320:17:433
2497299506,15cyclictest0-21swapper/220:05:072
2497299505,28cyclictest0-21swapper/222:29:422
2497299505,27cyclictest0-21swapper/218:39:542
2497299505,27cyclictest0-21swapper/218:24:392
2497299504,14cyclictest0-21swapper/222:55:032
24972995036,9cyclictest15203-21grep18:14:572
2497299503,41cyclictest7675-21grep19:05:092
24972995022,11cyclictest0-21swapper/220:39:532
24972995020,12cyclictest0-21swapper/220:59:442
2497199505,27cyclictest0-21swapper/119:09:391
2497199505,27cyclictest0-21swapper/117:36:091
2497199504,28cyclictest0-21swapper/118:00:041
2497199504,27cyclictest480-21fschecks_count17:44:591
2497199504,27cyclictest0-21swapper/119:00:151
2497199504,27cyclictest0-21swapper/118:49:151
2496499504,40cyclictest0-21swapper/022:17:420
2496499503,35cyclictest0-21swapper/021:45:450
2496499503,35cyclictest0-21swapper/021:00:460
2496499503,27cyclictest0-21swapper/021:29:330
24964995023,12cyclictest0-21swapper/021:39:520
24964995023,12cyclictest0-21swapper/021:39:520
248599500,4rtkit-daemon2484-21rtkit-daemon22:00:153
150092502,9sleep30-21swapper/319:20:413
130542502,9sleep30-21swapper/320:55:283
130542502,9sleep30-21swapper/320:55:283
127082502,9sleep00-21swapper/020:09:180
1010925014,31sleep017711-21diskmemload22:29:090
83632492,9sleep30-21swapper/319:09:403
7592492,42sleep00-21swapper/018:54:100
72122492,40sleep00-21swapper/017:59:450
24973994933,9cyclictest30838-21gltestperf17:39:593
2497399493,40cyclictest0-21swapper/320:04:283
24973994926,8cyclictest20228-21df20:19:493
2497299495,37cyclictest0-21swapper/218:34:502
2497299495,27cyclictest0-21swapper/220:54:452
2497299495,27cyclictest0-21swapper/220:54:452
2497299495,26cyclictest0-21swapper/217:29:592
2497299495,26cyclictest0-21swapper/217:29:592
24972994934,9cyclictest21888-21cpuspeed_turbos18:29:542
2497199495,26cyclictest0-21swapper/119:19:381
2497199494,27cyclictest0-21swapper/118:19:501
2496499494,39cyclictest0-21swapper/022:13:280
2496499494,38cyclictest0-21swapper/021:04:570
24964994933,10cyclictest18489-21grep18:20:120
24964994933,10cyclictest15061-21grep18:14:550
24964994929,14cyclictest0-21swapper/020:09:570
24964994921,12cyclictest0-21swapper/021:09:470
24964994919,17cyclictest26908-21ssh21:16:520
251862482,39sleep00-21swapper/017:29:510
251862482,39sleep00-21swapper/017:29:510
2497399484,38cyclictest5914-21switchtime20:45:063
2497299485,25cyclictest0-21swapper/218:10:022
2497299485,25cyclictest0-21swapper/218:10:022
2497299484,26cyclictest0-21swapper/221:17:472
24972994821,11cyclictest0-21swapper/222:01:052
24972994819,8cyclictest3367-21latency_hist18:59:392
24972994819,8cyclictest3367-21latency_hist18:59:392
2496499486,25cyclictest0-21swapper/020:19:520
2496499484,37cyclictest0-21swapper/021:34:070
2496499484,29cyclictest0-21swapper/020:15:050
2496499484,27cyclictest0-21swapper/022:44:460
24964994833,10cyclictest1778-21grep18:54:550
24964994833,10cyclictest1778-21grep18:54:550
2496499483,39cyclictest0-21swapper/019:32:410
54052472,10sleep20-21swapper/219:00:122
2497399474,36cyclictest0-21swapper/318:34:383
24973994734,8cyclictest17373-21cut18:19:573
2497399473,37cyclictest0-21swapper/320:49:453
24973994722,11cyclictest0-21swapper/320:09:473
2497299475,26cyclictest0-21swapper/217:49:172
2497299474,26cyclictest0-21swapper/217:51:122
2497299474,26cyclictest0-21swapper/217:39:542
24972994719,9cyclictest8374-21munin-node19:09:492
24964994721,12cyclictest0-21swapper/018:29:390
24964994720,12cyclictest0-21swapper/018:05:030
210662472,9sleep20-21swapper/218:26:192
116782472,9sleep20-21swapper/218:08:462
305372462,9sleep30-21swapper/318:45:183
2497399464,36cyclictest19810-21yum19:30:123
2497399464,36cyclictest0-21swapper/318:34:573
2497399463,38cyclictest0-21swapper/320:07:163
2497399462,39cyclictest0-21swapper/321:15:153
24973994619,12cyclictest0-21swapper/319:49:473
24973994619,12cyclictest0-21swapper/318:54:543
24973994619,12cyclictest0-21swapper/318:54:543
2497299464,25cyclictest0-21swapper/219:19:552
2496499464,34cyclictest0-21swapper/019:35:090
2496499464,34cyclictest0-21swapper/019:35:090
24964994631,9cyclictest25116-21cat18:35:040
2496499463,37cyclictest26497-21telnet18:39:510
2496499463,26cyclictest0-21swapper/018:59:530
20802462,9sleep00-21swapper/017:49:300
69172452,38sleep00-21swapper/017:58:530
2497399454,33cyclictest0-21swapper/317:34:533
2496499454,36cyclictest0-21swapper/018:10:080
2496499454,36cyclictest0-21swapper/018:10:080
24964994518,13cyclictest0-21swapper/017:39:510
24964994517,13cyclictest0-21swapper/017:49:530
19732452,9sleep30-21swapper/317:48:083
114632452,37sleep30-21swapper/318:05:573
79692442,9sleep30-21swapper/319:07:313
24973994430,9cyclictest6030-21needreboot17:55:043
24973994430,8cyclictest7937-21grep17:59:593
24973994417,11cyclictest0-21swapper/319:19:313
24972994431,8cyclictest30882-21turbostat18:49:382
24972994430,9cyclictest12465-21grep19:15:092
2497199444,32cyclictest0-21swapper/117:29:421
24964994421,11cyclictest0-21swapper/019:09:540
233922442,9sleep00-21swapper/018:30:320
2497399434,33cyclictest1287-21snmpd19:01:253
2497399433,34cyclictest0-21swapper/318:09:583
2497399433,34cyclictest0-21swapper/318:09:583
24973994328,9cyclictest3481-21grep17:50:013
2496499434,10cyclictest0-21swapper/019:04:520
2496499433,35cyclictest0-21swapper/019:24:490
2497399414,31cyclictest15559-21munin-node19:24:593
2497399413,32cyclictest1287-21snmpd17:31:093
2497399413,32cyclictest1287-21snmpd17:31:093
283952402,32sleep30-21swapper/318:43:293
2497399393,29cyclictest25103-21latency_hist17:29:423
24972993920,14cyclictest0-21swapper/217:29:412
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional