You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-01 - 06:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Fri May 01, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
31299910940,12cyclictest0-21swapper/119:14:501
248599710,6rtkit-daemon0-21swapper/217:01:190
248599690,5rtkit-daemon0-21swapper/216:59:423
3131996737,14cyclictest0-21swapper/316:59:383
3129996639,12cyclictest0-21swapper/121:49:551
3127996641,10cyclictest29366-21fschecks_count20:34:480
3127996641,10cyclictest29366-21fschecks_count20:34:480
312799664,54cyclictest0-21swapper/021:19:480
228152664,55sleep00-21swapper/021:13:300
51812653,54sleep05316-21fschecks_time21:34:460
3131996522,26cyclictest0-21swapper/317:45:063
3129996538,12cyclictest0-21swapper/118:06:211
312999653,55cyclictest0-21swapper/120:14:571
3127996540,12cyclictest0-21swapper/021:18:260
312799654,53cyclictest0-21swapper/021:44:580
312799654,52cyclictest0-21swapper/017:04:480
312799654,52cyclictest0-21swapper/017:04:480
3130996415,25cyclictest1243-21lldpd20:34:422
3130996415,25cyclictest1243-21lldpd20:34:422
312999649,46cyclictest0-21swapper/120:34:441
312999649,46cyclictest0-21swapper/120:34:441
3129996436,13cyclictest0-21swapper/119:24:551
312799645,52cyclictest0-21swapper/020:44:560
312799645,52cyclictest0-21swapper/020:39:550
312799644,53cyclictest0-21swapper/021:02:040
312799644,52cyclictest0-21swapper/019:05:060
3127996438,12cyclictest0-21swapper/019:49:520
3127996436,13cyclictest0-21swapper/020:24:450
3131996337,10cyclictest20259-21munin-run19:34:313
312999635,51cyclictest0-21swapper/117:49:351
312999634,52cyclictest0-21swapper/121:45:001
312999634,52cyclictest0-21swapper/120:29:541
3129996337,12cyclictest0-21swapper/121:19:581
3129996328,13cyclictest0-21swapper/119:20:061
312799635,51cyclictest0-21swapper/022:05:090
312799635,51cyclictest0-21swapper/020:14:310
312799634,52cyclictest0-21swapper/019:14:470
3131996238,8cyclictest14780-21ssh21:00:003
312999624,51cyclictest0-21swapper/120:19:441
3129996235,12cyclictest0-21swapper/121:29:451
3129996234,11cyclictest0-21swapper/117:19:501
3129996230,21cyclictest0-21swapper/119:31:181
3127996240,8cyclictest16821-21cat20:15:010
312799624,51cyclictest0-21swapper/022:14:580
312799624,51cyclictest0-21swapper/019:45:040
312799624,51cyclictest0-21swapper/017:29:580
312799624,49cyclictest0-21swapper/017:39:460
3127996236,12cyclictest0-21swapper/020:19:550
312799623,53cyclictest0-21swapper/021:42:260
3127996222,13cyclictest0-21swapper/017:29:360
313199614,50cyclictest16300-21iostat_ios20:14:523
3131996135,12cyclictest0-21swapper/319:22:013
313099615,26cyclictest0-21swapper/220:55:092
312999614,50cyclictest0-21swapper/121:09:281
312799615,51cyclictest0-21swapper/021:24:450
312799615,49cyclictest0-21swapper/019:54:450
312799615,49cyclictest0-21swapper/019:54:450
312799615,48cyclictest0-21swapper/021:49:410
312799614,50cyclictest0-21swapper/021:29:570
3127996136,12cyclictest0-21swapper/019:20:060
3127996135,12cyclictest0-21swapper/019:33:290
3127996133,13cyclictest0-21swapper/020:29:560
313199604,48cyclictest0-21swapper/321:44:523
3131996035,9cyclictest21109-21df_inode19:34:463
3130996017,37cyclictest0-21swapper/219:04:582
3129996040,8cyclictest2006-21cpuspeed_turbos19:54:441
3129996040,8cyclictest2006-21cpuspeed_turbos19:54:441
312999603,51cyclictest0-21swapper/122:24:251
312999603,51cyclictest0-21swapper/119:39:471
312999603,51cyclictest0-21swapper/118:25:061
312999603,50cyclictest0-21swapper/121:40:001
312799604,49cyclictest0-21swapper/022:19:520
312799604,49cyclictest0-21swapper/019:00:050
3127996036,12cyclictest0-21swapper/018:04:550
3131995936,9cyclictest32188-21telnet20:39:403
3131995936,9cyclictest28151-21diskmemload21:44:263
3131995933,10cyclictest2445-21fschecks_time19:54:483
3131995933,10cyclictest2445-21fschecks_time19:54:483
3131995931,13cyclictest0-21swapper/319:18:153
3130995941,11cyclictest22344-21unixbench_singl19:35:052
312999594,48cyclictest877-21grep19:05:031
312999594,48cyclictest0-21swapper/117:24:481
3129995935,10cyclictest1419-21runrttasks22:15:381
3129995934,12cyclictest0-21swapper/120:49:501
3129995934,12cyclictest0-21swapper/119:09:591
312999593,49cyclictest0-21swapper/120:44:291
312999592,51cyclictest0-21swapper/119:49:321
3127995939,9cyclictest0-21swapper/020:49:390
3127995939,7cyclictest22236-21ssh19:35:040
3127995936,7cyclictest6449-21rm19:14:330
3127995933,12cyclictest0-21swapper/021:59:360
3127995933,12cyclictest0-21swapper/021:59:360
312799593,51cyclictest0-21swapper/021:08:380
3131995835,9cyclictest3189-21ssh22:21:523
3131995835,9cyclictest2930-21kworker/3:019:09:563
3131995835,8cyclictest21387-21ssh21:09:563
3131995833,10cyclictest3966-21yum-updatesd-he20:45:043
3131995833,10cyclictest23910-21cut22:04:473
313199583,49cyclictest0-21swapper/319:45:003
313199583,46cyclictest4981-21fschecks_time22:24:433
312999585,47cyclictest10928-21munin-node20:54:521
312999584,47cyclictest22804-21date22:04:261
312999584,47cyclictest22804-21date22:04:261
312999583,49cyclictest0-21swapper/122:29:251
312999583,49cyclictest0-21swapper/120:44:561
312999583,49cyclictest0-21swapper/117:55:001
3127995836,11cyclictest0-21swapper/020:54:460
3127995836,11cyclictest0-21swapper/019:29:190
312799583,50cyclictest0-21swapper/022:24:420
312799583,49cyclictest8142-21chrt20:04:110
312799583,48cyclictest19314-21crond21:59:260
312799582,50cyclictest0-21swapper/017:10:020
209752583,11sleep30-21swapper/321:59:533
209752583,11sleep30-21swapper/321:59:533
111422584,47sleep00-21swapper/017:14:550
98432573,47sleep09855-21forks18:19:520
313199574,46cyclictest1287-21snmpd18:25:073
3131995738,11cyclictest30586-21gltestperf22:14:483
313199573,47cyclictest7293-21rm20:01:063
3131995726,13cyclictest0-21swapper/320:29:413
3129995735,8cyclictest23080-21ssh21:14:271
3129995733,9cyclictest23500-21awk20:25:001
3129995731,14cyclictest0-21swapper/122:04:371
3129995730,12cyclictest0-21swapper/118:20:041
312999573,49cyclictest0-21swapper/121:28:571
312999573,48cyclictest0-21swapper/119:59:581
312999573,48cyclictest0-21swapper/119:36:171
3127995735,11cyclictest0-21swapper/020:04:470
3127995735,10cyclictest0-21swapper/018:24:550
3127995730,12cyclictest0-21swapper/019:40:040
3131995637,12cyclictest27452-21grep21:19:463
3131995635,8cyclictest11407-21ssh20:55:013
3131995635,7cyclictest19620-21rm21:09:083
3131995631,11cyclictest6394-21users21:35:023
3131995626,13cyclictest0-21swapper/317:21:033
3130995638,10cyclictest3490-21grep20:44:432
312999564,47cyclictest0-21swapper/118:39:341
3129995636,10cyclictest0-21swapper/122:09:471
3129995634,11cyclictest0-21swapper/121:17:131
3129995634,11cyclictest0-21swapper/118:09:461
3129995633,12cyclictest0-21swapper/119:53:201
3129995630,12cyclictest0-21swapper/117:44:351
312999563,48cyclictest0-21swapper/120:59:441
312999563,47cyclictest5512-21idleruntime21:34:491
312799565,44cyclictest0-21swapper/018:45:070
312799563,49cyclictest0-21swapper/022:10:010
312799563,47cyclictest16334-21seq18:34:340
312799563,47cyclictest16334-21seq18:34:340
3127995628,13cyclictest0-21swapper/018:54:550
213452563,47sleep20-21swapper/220:23:132
3131995532,9cyclictest32080-21cut17:59:503
3131995530,11cyclictest31948-21telnet19:04:453
313199553,45cyclictest20628-21diskstats17:34:523
3131995527,13cyclictest0-21swapper/319:54:223
3131995527,12cyclictest0-21swapper/318:19:533
3131995525,11cyclictest0-21swapper/318:49:333
3131995513,12cyclictest0-21swapper/320:49:503
313099553,29cyclictest0-21swapper/220:09:592
3129995534,10cyclictest0-21swapper/118:00:111
3129995534,10cyclictest0-21swapper/117:10:051
3129995533,11cyclictest0-21swapper/118:49:461
3129995532,12cyclictest0-21swapper/120:08:171
3129995532,12cyclictest0-21swapper/117:00:021
3129995532,10cyclictest0-21swapper/118:44:501
312999553,47cyclictest0-21swapper/120:10:151
3129995526,14cyclictest0-21swapper/121:57:111
312799556,43cyclictest0-21swapper/017:45:050
312799553,47cyclictest0-21swapper/017:39:360
312799553,47cyclictest0-21swapper/016:59:380
312799553,46cyclictest0-21swapper/017:24:370
159762552,9sleep30-21swapper/319:26:223
3131995436,7cyclictest28151-21diskmemload19:01:553
3131995433,8cyclictest30397-21kworker/3:220:05:373
3131995433,8cyclictest16903-21kworker/3:120:20:233
3131995431,10cyclictest16845-21sshd21:51:123
3131995430,8cyclictest361ktimersoftd/318:54:543
3131995429,9cyclictest12473-21diskstats20:09:473
3131995428,11cyclictest0-21swapper/320:28:343
3131995426,13cyclictest0-21swapper/320:35:013
3131995426,13cyclictest0-21swapper/320:35:013
3131995425,14cyclictest0-21swapper/321:14:433
3131995423,15cyclictest0-21swapper/321:29:283
3131995423,13cyclictest0-21swapper/321:29:483
313099545,14cyclictest0-21swapper/220:42:112
3129995433,11cyclictest0-21swapper/118:59:491
3129995433,10cyclictest0-21swapper/117:16:361
3129995432,11cyclictest0-21swapper/117:30:011
3129995428,12cyclictest0-21swapper/117:04:481
3129995428,12cyclictest0-21swapper/117:04:481
313199538,27cyclictest0-21swapper/322:09:513
313199534,29cyclictest0-21swapper/319:39:493
3131995331,8cyclictest10502-21munin-node17:15:063
3131995325,13cyclictest0-21swapper/317:40:063
3130995338,10cyclictest27553-21cpuspeed_turbos17:49:492
3130995338,10cyclictest27553-21cpuspeed_turbos17:49:492
3130995338,10cyclictest16745-21cpuspeed_turbos18:34:472
313099533,35cyclictest0-21swapper/219:39:492
3127995331,11cyclictest0-21swapper/018:39:470
87722523,12sleep20-21swapper/218:16:202
86292522,9sleep20-21swapper/220:50:512
3131995227,9cyclictest8176-21telnet17:09:483
3131995225,13cyclictest0-21swapper/321:54:433
3131995221,12cyclictest0-21swapper/318:39:343
313099525,41cyclictest0-21swapper/218:04:502
313099524,38cyclictest0-21swapper/221:34:432
313099524,12cyclictest0-21swapper/221:44:592
3130995237,10cyclictest20346-21cpuspeed_turbos21:09:422
3130995236,10cyclictest4824-21cpuspeed_turbos18:09:482
313099523,9cyclictest0-21swapper/222:28:062
3129995230,10cyclictest0-21swapper/118:39:581
3129995228,12cyclictest0-21swapper/116:59:381
312799524,42cyclictest27214-21munin-node17:50:020
312799524,42cyclictest27214-21munin-node17:50:020
3127995229,12cyclictest0-21swapper/017:54:570
41692512,10sleep20-21swapper/216:59:582
3131995130,7cyclictest361ktimersoftd/317:24:563
3131995128,10cyclictest23719-21telnet18:49:463
3130995135,9cyclictest27563-21needreboot22:09:492
312999513,43cyclictest0-21swapper/118:29:541
312999513,43cyclictest0-21swapper/118:29:541
312999513,43cyclictest0-21swapper/117:49:571
312999513,43cyclictest0-21swapper/117:49:571
3127995123,12cyclictest0-21swapper/018:49:480
189842513,42sleep219026-21processes17:30:052
313342502,9sleep20-21swapper/219:03:362
3131995034,9cyclictest5347-21tail18:09:533
313199503,42cyclictest0-21swapper/317:52:103
313199503,42cyclictest0-21swapper/317:52:103
313199503,40cyclictest0-21swapper/317:29:483
3131995024,12cyclictest0-21swapper/318:05:023
3131995021,12cyclictest0-21swapper/318:14:513
313099505,37cyclictest14711-21aten2.4-expect21:49:382
3129995028,11cyclictest0-21swapper/118:14:551
3129995016,29cyclictest27297-21open_inodes18:55:021
312799509,36cyclictest0-21swapper/018:01:190
312799504,39cyclictest0-21swapper/018:34:470
3127995022,10cyclictest0-21swapper/018:15:030
248599500,4rtkit-daemon2484-21rtkit-daemon16:55:122
313099495,39cyclictest0-21swapper/220:59:502
3130994933,10cyclictest1379-21cpuspeed_turbos21:29:432
3127994922,14cyclictest0-21swapper/018:10:030
97712483,38sleep20-21swapper/219:19:042
61682482,9sleep20-21swapper/219:13:522
313099485,37cyclictest28101-21yum-updatesd-he19:44:572
313099485,14cyclictest0-21swapper/217:10:112
313099484,40cyclictest0-21swapper/220:26:382
313099484,40cyclictest0-21swapper/219:54:482
313099484,40cyclictest0-21swapper/219:54:482
313099484,39cyclictest0-21swapper/218:45:032
3130994833,10cyclictest30419-21tail17:54:532
3130994832,10cyclictest24144-21cut21:14:462
3130994832,10cyclictest12037-21unixbench_singl19:20:072
3130994830,9cyclictest25193-21grep17:44:502
3130994811,25cyclictest0-21swapper/219:59:462
3131994724,10cyclictest0-21swapper/317:06:113
3131994724,10cyclictest0-21swapper/317:06:113
313099475,37cyclictest0-21swapper/217:14:492
313099474,16cyclictest0-21swapper/217:04:532
313099474,16cyclictest0-21swapper/217:04:532
3130994732,10cyclictest25013-21sendmail_mailqu18:50:032
3130994732,10cyclictest18947-21grep19:30:052
3130994730,10cyclictest15606-21grep17:24:492
3130994728,10cyclictest15505-21grep19:25:042
3130994724,14cyclictest1419-21runrttasks20:16:442
3129994718,12cyclictest0-21swapper/117:34:571
12862472,39sleep20-21swapper/219:54:192
3131994622,10cyclictest0-21swapper/318:30:043
3131994622,10cyclictest0-21swapper/318:30:043
3131994620,10cyclictest24287-21munin-node18:39:453
313099466,34cyclictest0-21swapper/221:59:482
313099466,34cyclictest0-21swapper/221:59:482
313099464,13cyclictest0-21swapper/220:09:252
313099464,13cyclictest0-21swapper/217:34:532
3130994632,8cyclictest9687-21unixbench_multi21:40:022
3130994631,9cyclictest25704-21cpuspeed_turbos20:29:432
3130994626,12cyclictest0-21swapper/217:39:502
188492462,9sleep20-21swapper/221:06:182
317282452,37sleep30-21swapper/317:59:123
313099454,35cyclictest0-21swapper/218:39:502
3130994531,8cyclictest14587-21unixbench_multi17:20:092
3130994527,12cyclictest0-21swapper/221:54:502
3130994522,13cyclictest26067-21rm22:09:262
3130994520,15cyclictest0-21swapper/221:21:392
313099448,29cyclictest9648-21cstates18:19:502
313099446,29cyclictest0-21swapper/222:20:002
313099445,31cyclictest0-21swapper/221:24:582
3130994421,13cyclictest0-21swapper/222:18:252
15752442,9sleep20-21swapper/218:02:332
313099434,34cyclictest0-21swapper/218:29:562
313099434,34cyclictest0-21swapper/218:29:562
313099433,35cyclictest0-21swapper/218:24:452
3130994224,12cyclictest0-21swapper/218:58:182
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional