You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-01 - 03:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Tue Sep 01, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2194991350,5rtkit-daemon2193-21rtkit-daemon19:10:530
2194991060,2rtkit-daemon0-21swapper/121:51:251
2194991060,2rtkit-daemon0-21swapper/121:51:251
825699954,67cyclictest0-21swapper/122:42:461
219499940,6rtkit-daemon2193-21rtkit-daemon22:33:153
219499940,6rtkit-daemon2193-21rtkit-daemon22:33:153
825699934,68cyclictest0-21swapper/120:10:421
825699903,65cyclictest0-21swapper/119:46:251
825699903,65cyclictest0-21swapper/119:46:251
825699894,78cyclictest0-21swapper/122:38:191
825699894,78cyclictest0-21swapper/120:59:221
825699894,77cyclictest0-21swapper/122:11:511
825699894,66cyclictest0-21swapper/122:50:311
825699893,67cyclictest12416-21cstates20:45:501
825699886,75cyclictest0-21swapper/120:54:041
825699883,66cyclictest0-21swapper/119:31:091
825699874,75cyclictest0-21swapper/121:18:071
825699874,66cyclictest9630-21sort21:30:461
825699873,76cyclictest14582-21date20:00:381
825699873,73cyclictest16213-21cpuspeed_turbos21:40:451
219499870,5rtkit-daemon2193-21rtkit-daemon22:20:531
219499870,5rtkit-daemon2193-21rtkit-daemon19:50:520
825699864,75cyclictest0-21swapper/122:59:131
825699863,76cyclictest0-21swapper/122:29:471
825699863,76cyclictest0-21swapper/119:25:501
825699863,62cyclictest27041-21netstat21:55:571
219499860,5rtkit-daemon2193-21rtkit-daemon21:10:561
219499860,5rtkit-daemon2193-21rtkit-daemon21:10:561
825699854,71cyclictest0-21swapper/119:55:371
825699854,66cyclictest0-21swapper/120:34:361
825699854,66cyclictest0-21swapper/120:34:361
825699854,65cyclictest0-21swapper/121:37:171
825699854,62cyclictest8877-21sshd21:29:481
825699854,62cyclictest0-21swapper/122:32:261
825699854,62cyclictest0-21swapper/122:32:261
825699854,60cyclictest0-21swapper/120:01:031
825699853,75cyclictest0-21swapper/123:08:411
825699853,75cyclictest0-21swapper/121:25:321
825699853,73cyclictest1227-21runrttasks22:20:101
825699853,63cyclictest31143-21kworker/1:120:35:521
219499850,4rtkit-daemon2193-21rtkit-daemon18:50:391
825699844,72cyclictest31560-21df20:25:521
825699844,72cyclictest31560-21df20:25:521
825699844,65cyclictest0-21swapper/122:50:451
825699843,73cyclictest9055-21grep20:40:501
825699843,63cyclictest0-21swapper/121:45:451
825699843,61cyclictest30117-21ssh20:22:481
825699835,58cyclictest0-21swapper/120:05:471
825699834,72cyclictest3047-21perl23:00:491
825699834,71cyclictest0-21swapper/122:05:511
825699834,70cyclictest0-21swapper/118:06:091
825699833,71cyclictest0-21swapper/121:09:351
825699824,64cyclictest0-21swapper/119:36:521
825699824,60cyclictest0-21swapper/119:44:141
825699824,58cyclictest0-21swapper/122:03:311
825699823,56cyclictest0-21swapper/121:01:381
219499820,4rtkit-daemon2193-21rtkit-daemon18:55:540
825699814,69cyclictest0-21swapper/118:25:581
825699804,58cyclictest0-21swapper/119:11:041
825699804,57cyclictest0-21swapper/117:41:051
825699804,47cyclictest0-21swapper/117:45:591
825699803,69cyclictest0-21swapper/120:17:111
825699803,51cyclictest0-21swapper/117:56:041
825699798,49cyclictest0-21swapper/118:56:541
825699794,68cyclictest0-21swapper/119:20:501
825699794,53cyclictest0-21swapper/118:11:111
825699793,56cyclictest26200-21runrttasks18:16:031
825699793,54cyclictest0-21swapper/118:36:071
219499790,6rtkit-daemon0-21swapper/118:02:331
219499790,5rtkit-daemon2193-21rtkit-daemon23:00:290
825699784,52cyclictest0-21swapper/119:09:531
825699784,52cyclictest0-21swapper/119:09:531
825699783,56cyclictest22131-21diskstats19:15:561
219499770,5rtkit-daemon2193-21rtkit-daemon21:52:390
219499770,5rtkit-daemon2193-21rtkit-daemon21:52:390
219499760,4rtkit-daemon2193-21rtkit-daemon21:15:260
219499760,4rtkit-daemon2193-21rtkit-daemon21:15:260
825699753,64cyclictest0-21swapper/118:52:251
219499750,4rtkit-daemon2193-21rtkit-daemon18:45:540
219499750,30rtkit-daemon2193-21rtkit-daemon20:53:570
825699748,44cyclictest107550irq/46-eth018:30:521
825699743,54cyclictest0-21swapper/117:51:401
825699743,53cyclictest0-21swapper/119:00:531
825699743,52cyclictest5874-21iostat_ios18:41:021
219499730,4rtkit-daemon2193-21rtkit-daemon23:08:440
219499730,4rtkit-daemon2193-21rtkit-daemon21:19:110
825699723,62cyclictest0-21swapper/118:21:121
825699669,40cyclictest107550irq/46-eth017:40:421
825699669,40cyclictest107550irq/46-eth017:40:421
310742614,12sleep30-21swapper/321:14:023
310742614,12sleep30-21swapper/321:14:023
292912604,13sleep30-21swapper/319:30:563
9232593,48sleep00-21swapper/018:31:040
219499590,4rtkit-daemon6177-21kworker/0:021:34:330
180682593,48sleep00-21swapper/019:06:060
180682593,48sleep00-21swapper/019:06:060
87652583,47sleep00-21swapper/021:29:230
8258995831,13cyclictest0-21swapper/322:07:473
825299583,48cyclictest0-21swapper/020:23:210
8258995713,36cyclictest28270-21df20:20:503
825799575,44cyclictest0-21swapper/222:40:532
825799574,13cyclictest0-21swapper/220:21:032
825299574,36cyclictest0-21swapper/022:17:480
825299573,35cyclictest0-21swapper/022:37:150
8252995717,25cyclictest1227-21runrttasks20:06:210
248782573,12sleep00-21swapper/021:05:330
825799569,41cyclictest1227-21runrttasks21:16:572
825799565,44cyclictest0-21swapper/220:40:572
825799565,11cyclictest26107-21tr21:55:452
825799564,45cyclictest0-21swapper/222:55:472
825299564,22cyclictest0-21swapper/019:56:060
825299563,19cyclictest22339-21ls21:50:330
290322562,10sleep00-21swapper/022:00:350
276282562,11sleep00-21swapper/022:50:250
219499560,4rtkit-daemon13481-21rt-features20:46:050
128582562,11sleep00-21swapper/022:25:010
8258995530,12cyclictest0-21swapper/320:47:183
8257995511,36cyclictest0-21swapper/221:20:552
8257995510,39cyclictest12560-21df_abs20:45:512
825299553,40cyclictest0-21swapper/022:30:150
8252995517,24cyclictest22209-21grep22:40:460
68332552,11sleep00-21swapper/019:47:580
68332552,11sleep00-21swapper/019:47:580
44772552,10sleep00-21swapper/018:39:020
219499550,6rtkit-daemon2193-21rtkit-daemon22:50:450
825799548,40cyclictest25208-21fschecks_count20:15:532
825799545,43cyclictest0-21swapper/223:06:022
825799544,43cyclictest2962-21ssh20:30:532
825799544,43cyclictest2962-21ssh20:30:532
825799544,42cyclictest0-21swapper/220:50:482
8257995433,15cyclictest0-21swapper/220:06:072
825799543,15cyclictest0-21swapper/221:39:342
825799542,46cyclictest0-21swapper/220:36:452
825299544,44cyclictest0-21swapper/020:26:360
825299544,44cyclictest0-21swapper/020:26:360
825299544,30cyclictest0-21swapper/022:05:440
825299543,37cyclictest0-21swapper/017:54:150
46842542,10sleep20-21swapper/223:03:202
287742542,9sleep20-21swapper/218:21:062
219499540,5rtkit-daemon2193-21rtkit-daemon19:16:080
219499540,4rtkit-daemon6438-21latency_hist22:15:310
825899533,41cyclictest0-21swapper/319:50:583
825799535,42cyclictest0-21swapper/220:58:022
8257995334,7cyclictest107550irq/46-eth021:27:472
8257995315,8cyclictest0-21swapper/222:52:532
8257995315,31cyclictest1227-21runrttasks22:37:422
825299535,29cyclictest0-21swapper/021:06:040
825299534,30cyclictest0-21swapper/022:30:550
825299534,30cyclictest0-21swapper/022:30:550
5912532,11sleep00-21swapper/019:37:540
40032533,8sleep04006-21ssh20:31:110
40032533,8sleep04006-21ssh20:31:110
219499530,4rtkit-daemon26280-21sed21:55:470
145122532,10sleep30-21swapper/322:25:573
825799528,37cyclictest3654-21ssh22:10:452
825799524,42cyclictest0-21swapper/221:30:502
825799524,41cyclictest0-21swapper/222:45:402
8257995236,9cyclictest22109-21grep20:10:552
825799523,41cyclictest0-21swapper/222:25:452
825799523,13cyclictest0-21swapper/221:45:022
8257995221,8cyclictest20404-21munin-node18:05:542
8257995217,13cyclictest0-21swapper/221:03:262
825299525,14cyclictest0-21swapper/021:36:030
825299525,13cyclictest0-21swapper/020:42:290
825299524,42cyclictest21861-21ssh20:10:510
825299524,31cyclictest0-21swapper/021:20:560
825299524,29cyclictest0-21swapper/020:35:550
825299524,28cyclictest0-21swapper/020:16:050
825299523,12cyclictest0-21swapper/020:01:050
258212522,11sleep00-21swapper/019:22:100
219499520,5rtkit-daemon2193-21rtkit-daemon17:40:420
219499520,5rtkit-daemon2193-21rtkit-daemon17:40:420
85162512,10sleep30-21swapper/323:10:273
825799519,36cyclictest281ktimersoftd/222:05:422
825799517,38cyclictest0-21swapper/219:45:522
825799517,38cyclictest0-21swapper/219:45:522
825799514,40cyclictest0-21swapper/220:26:272
825799514,40cyclictest0-21swapper/220:26:272
8257995131,14cyclictest0-21swapper/221:50:452
8257995131,14cyclictest0-21swapper/221:50:452
825799513,40cyclictest8212-21ssh22:16:022
8257995122,7cyclictest0-21swapper/222:20:552
8257995122,14cyclictest0-21swapper/218:05:402
825799512,30cyclictest17554-21tune2fs19:05:572
825799512,30cyclictest17554-21tune2fs19:05:572
8252995122,12cyclictest0-21swapper/019:31:060
246462512,10sleep30-21swapper/318:11:563
219499510,5rtkit-daemon2193-21rtkit-daemon21:43:170
219499510,5rtkit-daemon2193-21rtkit-daemon20:55:490
219499510,5rtkit-daemon2193-21rtkit-daemon18:15:550
219499510,4rtkit-daemon2193-21rtkit-daemon18:55:160
219499510,4rtkit-daemon2193-21rtkit-daemon18:11:030
189202512,43sleep00-21swapper/018:01:010
186262512,9sleep20-21swapper/222:31:482
186262512,9sleep20-21swapper/222:31:482
143932512,42sleep00-21swapper/019:00:460
825899508,36cyclictest0-21swapper/319:57:483
825899506,39cyclictest0-21swapper/321:26:253
8258995036,9cyclictest29849-21cut22:00:513
8258995036,8cyclictest15520-21gltestperf20:00:573
8258995035,9cyclictest23735-21needreboot21:50:563
8258995035,9cyclictest23735-21needreboot21:50:563
825899503,40cyclictest0-21swapper/322:50:473
8258995028,14cyclictest0-21swapper/320:30:543
8258995028,14cyclictest0-21swapper/320:30:543
8258995024,22cyclictest0-21swapper/322:57:123
825799505,39cyclictest0-21swapper/218:32:432
8257995034,10cyclictest13603-21grep17:50:552
8257995033,10cyclictest22226-21crond21:50:322
8257995022,8cyclictest23705-21latency_hist19:20:392
825299504,28cyclictest0-21swapper/019:25:520
825299504,28cyclictest0-21swapper/018:06:150
825299503,11cyclictest0-21swapper/017:46:400
248322502,10sleep20-21swapper/218:14:212
219499500,5rtkit-daemon2193-21rtkit-daemon19:40:520
219499500,5rtkit-daemon2193-21rtkit-daemon17:55:560
204732502,9sleep30-21swapper/322:38:103
8258994935,8cyclictest361ktimersoftd/322:45:573
825899493,40cyclictest0-21swapper/320:10:563
825899493,40cyclictest0-21swapper/318:55:593
825899493,39cyclictest25429-21sed20:15:553
825899492,42cyclictest0-21swapper/322:40:543
8258994910,33cyclictest361ktimersoftd/321:05:533
825799498,35cyclictest29711-21grep22:00:502
825799496,37cyclictest21343-21cat19:15:392
8257994921,8cyclictest11782-21latency_hist18:55:392
8257994921,13cyclictest0-21swapper/217:40:422
8257994921,13cyclictest0-21swapper/217:40:422
8252994920,12cyclictest0-21swapper/018:20:520
8252994913,10cyclictest2397-21cpu23:00:430
67422493,39sleep30-21swapper/319:47:363
67422493,39sleep30-21swapper/319:47:363
317402492,41sleep00-21swapper/018:26:160
21542492,10sleep30-21swapper/323:00:353
104642492,10sleep00-21swapper/017:43:400
8258994834,8cyclictest7508-21cpuspeed_turbos18:45:533
8258994828,9cyclictest0-21swapper/319:44:523
825899482,41cyclictest0-21swapper/320:44:493
825799488,12cyclictest0-21swapper/221:10:512
825799488,12cyclictest0-21swapper/221:10:512
825799485,37cyclictest0-21swapper/219:30:532
825799484,38cyclictest0-21swapper/219:59:292
825799484,36cyclictest4973-21head18:40:532
8257994832,9cyclictest8701-21gltestperf19:50:562
8257994829,14cyclictest0-21swapper/220:00:552
825299484,26cyclictest0-21swapper/018:41:020
220912482,10sleep30-21swapper/321:50:023
176912482,10sleep20-21swapper/217:59:342
825899475,38cyclictest0-21swapper/320:36:413
825899474,37cyclictest0-21swapper/320:56:023
8258994733,9cyclictest14119-21find21:36:023
825899473,38cyclictest0-21swapper/321:20:553
825799475,26cyclictest0-21swapper/221:05:412
79292474,36sleep30-21swapper/317:36:553
79292474,36sleep30-21swapper/317:36:553
825899467,33cyclictest0-21swapper/322:23:103
825899465,36cyclictest1227-21runrttasks19:25:593
825899463,38cyclictest0-21swapper/321:59:523
8258994624,18cyclictest0-21swapper/321:42:483
825899462,39cyclictest0-21swapper/320:29:153
825899462,39cyclictest0-21swapper/320:29:153
8258994617,11cyclictest9778-21cat22:20:313
8257994631,10cyclictest2074-21gltestperf19:40:552
825799463,37cyclictest14761-21cpuspeed_turbos19:00:522
26162462,9sleep20-21swapper/218:35:532
18622462,10sleep30-21swapper/321:18:383
127852462,9sleep20-21swapper/217:47:492
825899455,34cyclictest0-21swapper/318:01:053
825899454,34cyclictest0-21swapper/321:00:403
825899454,34cyclictest0-21swapper/320:51:083
825899454,12cyclictest0-21swapper/319:16:033
8258994523,18cyclictest0-21swapper/318:22:283
8258994519,7cyclictest107550irq/46-eth020:05:473
825799454,35cyclictest0-21swapper/218:56:122
825799454,35cyclictest0-21swapper/218:45:512
825799453,11cyclictest26362-21missed_timers18:16:052
282022452,9sleep20-21swapper/219:27:082
224662452,9sleep30-21swapper/318:09:393
177022452,10sleep30-21swapper/317:59:433
825899446,8cyclictest34-21rcuc/319:00:493
8258994430,8cyclictest18935-21sadc19:10:383
8258994430,8cyclictest18935-21sadc19:10:383
825899443,20cyclictest0-21swapper/317:41:123
8258994429,9cyclictest30223-21cpuspeed_turbos18:25:543
8258994422,7cyclictest107550irq/46-eth022:10:453
825799444,34cyclictest0-21swapper/219:35:512
254612442,35sleep30-21swapper/318:15:553
142762443,34sleep30-21swapper/317:51:053
825899434,32cyclictest0-21swapper/319:10:503
8258994310,26cyclictest11400-21rm21:31:463
825799434,33cyclictest0-21swapper/219:21:102
8257994328,9cyclictest30501-21df_abs18:25:562
825899425,33cyclictest0-21swapper/317:46:073
825899423,33cyclictest361ktimersoftd/318:40:403
825799428,29cyclictest0-21swapper/217:41:122
825899415,14cyclictest0-21swapper/318:51:053
825899414,31cyclictest31807-21fschecks_time19:35:553
825899413,11cyclictest0-21swapper/318:40:523
8258994124,11cyclictest0-21swapper/319:21:103
8258994117,10cyclictest0-21swapper/318:30:553
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional