You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-12 - 07:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Fri Jun 12, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
15783211695,16sleep20-21swapper/219:08:092
158762115103,6sleep10-21swapper/119:09:211
15687211593,16sleep00-21swapper/019:06:560
15744210184,12sleep30-21swapper/319:07:383
135662720,0sleep20-21swapper/223:10:522
184082690,0sleep00-21swapper/023:16:040
59052640,0sleep10-21swapper/123:37:581
59052640,0sleep10-21swapper/123:37:571
123592630,1sleep20-21swapper/200:20:152
15958994015,23cyclictest0-21swapper/321:55:103
1595899360,18cyclictest0-21swapper/321:45:093
192232350,0sleep10-21swapper/123:17:011
9472320,1sleep30-21swapper/300:07:543
1595899311,28cyclictest0-21swapper/323:15:123
1595899210,19cyclictest0-21swapper/322:15:123
1595699211,2cyclictest0-21swapper/123:20:121
1595699200,18cyclictest0-21swapper/121:10:121
15957991815,2cyclictest16191-21kworker/u8:122:24:052
1595799180,2cyclictest0-21swapper/219:41:052
15955991714,2cyclictest28282-21kworker/u8:019:41:050
1595899161,13cyclictest0-21swapper/320:25:003
1595799161,13cyclictest3728-21runrttasks19:30:592
15957991611,3cyclictest28127-21sed19:40:002
1595799160,14cyclictest25422-21latency_hist00:00:012
1595699161,12cyclictest0-21swapper/122:26:091
15958991512,2cyclictest0-21swapper/322:40:173
1595899151,12cyclictest21544-21ssh22:45:043
1595899151,12cyclictest0-21swapper/323:33:283
15958991510,3cyclictest0-21swapper/321:33:433
1595899150,3cyclictest3649-21snmpd22:11:343
1595899150,2cyclictest0-21swapper/321:22:373
1595899150,13cyclictest0-21swapper/300:19:143
15957991512,2cyclictest32362-21apt-get19:50:102
1595699151,3cyclictest0-21swapper/122:21:351
1595699151,12cyclictest0-21swapper/123:05:151
15956991510,3cyclictest4266-21sensors_temp00:11:011
1595699150,13cyclictest0-21swapper/121:15:011
1595699150,13cyclictest0-21swapper/100:17:211
1595599151,12cyclictest3728-21runrttasks21:39:260
106952151,3sleep20-21swapper/221:56:342
249882140,11sleep30-21swapper/323:23:573
1595899149,3cyclictest22552-21python00:31:043
1595899149,3cyclictest15039-21ssh23:47:553
1595899149,3cyclictest15039-21ssh23:47:553
1595899141,2cyclictest3480-21apt-get21:50:063
15958991411,2cyclictest0-21swapper/322:58:463
15958991411,2cyclictest0-21swapper/322:30:563
15958991411,2cyclictest0-21swapper/300:12:473
1595899141,11cyclictest1060-21ssh22:21:393
1595899141,11cyclictest0-21swapper/321:25:333
1595899140,13cyclictest0-21swapper/323:25:273
1595899140,12cyclictest4108-21ssh23:00:443
1595899140,12cyclictest0-21swapper/321:35:123
15957991411,2cyclictest939-21kworker/u8:022:59:042
1595799141,11cyclictest27108-21ssh23:25:302
15957991410,2cyclictest26876-21iostat_ios22:50:172
1595799140,12cyclictest0-21swapper/222:34:052
1595799140,12cyclictest0-21swapper/219:21:002
1595699141,3cyclictest13181-21cut23:10:171
1595699141,2cyclictest16572-21apt-get23:50:101
1595699141,2cyclictest0-21swapper/122:13:541
15956991410,2cyclictest22561-21latency_hist21:35:001
15956991410,2cyclictest0-21swapper/121:25:001
1595699140,3cyclictest763-21ssh23:32:201
1595699140,2cyclictest0-21swapper/100:34:121
1595699140,13cyclictest0-21swapper/122:50:221
1595699140,12cyclictest31310-21diskmemload23:47:521
1595699140,12cyclictest31310-21diskmemload23:47:521
1595699140,12cyclictest0-21swapper/122:55:421
1595699140,12cyclictest0-21swapper/121:40:121
1595699140,12cyclictest0-21swapper/100:29:361
15955991411,2cyclictest0-21swapper/023:22:520
15955991411,2cyclictest0-21swapper/021:57:190
15955991411,2cyclictest0-21swapper/021:46:280
15955991411,2cyclictest0-21swapper/021:40:590
15955991411,2cyclictest0-21swapper/019:20:180
15955991411,2cyclictest0-21swapper/000:15:180
1595599140,2cyclictest0-21swapper/022:36:380
1595599140,2cyclictest0-21swapper/022:34:490
1595599140,2cyclictest0-21swapper/000:04:390
1595599140,13cyclictest0-21swapper/000:25:490
1595599140,13cyclictest0-21swapper/000:23:490
278792130,2sleep20-21swapper/222:15:272
226692130,2sleep10-21swapper/121:35:091
1595899138,3cyclictest24152-21cut20:50:113
1595899132,6cyclictest0-21swapper/323:55:013
1595899132,6cyclictest0-21swapper/319:34:593
1595899132,5cyclictest0-21swapper/322:09:593
1595899131,3cyclictest0-21swapper/300:29:233
15958991310,2cyclictest25676-21ssh00:00:033
15958991310,2cyclictest0-21swapper/323:56:333
15958991310,2cyclictest0-21swapper/323:41:583
15958991310,2cyclictest0-21swapper/322:00:163
1595899130,2cyclictest0-21swapper/322:26:093
1595899130,2cyclictest0-21swapper/321:18:473
1595899130,2cyclictest0-21swapper/320:36:023
1595899130,2cyclictest0-21swapper/320:36:023
1595899130,12cyclictest0-21swapper/323:35:083
1595899130,12cyclictest0-21swapper/323:35:083
1595899130,12cyclictest0-21swapper/323:05:303
1595899130,12cyclictest0-21swapper/320:40:113
1595899130,11cyclictest0-21swapper/322:35:283
1595899130,11cyclictest0-21swapper/300:21:293
1595799131,10cyclictest0-21swapper/222:02:412
15957991310,2cyclictest27431-21kworker/u8:222:28:052
15957991310,2cyclictest23510-21kworker/u8:100:08:052
15957991310,2cyclictest17690-21kworker/u8:000:26:042
15957991310,2cyclictest0-21swapper/222:05:142
1595799130,2cyclictest0-21swapper/221:50:192
1595799130,2cyclictest0-21swapper/220:20:112
1595799130,12cyclictest0-21swapper/223:40:012
1595799130,12cyclictest0-21swapper/223:40:002
1595699138,3cyclictest14312-21perl20:25:131
1595699138,3cyclictest0-21swapper/122:05:311
15956991310,2cyclictest0-21swapper/123:25:291
15956991310,2cyclictest0-21swapper/100:36:221
1595699130,2cyclictest0-21swapper/122:19:021
1595699130,12cyclictest0-21swapper/100:06:421
1595699130,11cyclictest25804-21ssh22:49:561
15955991310,2cyclictest31310-21diskmemload22:28:410
15955991310,2cyclictest0-21swapper/023:14:250
15955991310,2cyclictest0-21swapper/023:06:190
15955991310,2cyclictest0-21swapper/022:10:430
15955991310,2cyclictest0-21swapper/021:51:580
15955991310,2cyclictest0-21swapper/021:30:150
15955991310,2cyclictest0-21swapper/021:25:030
15955991310,2cyclictest0-21swapper/021:10:450
15955991310,2cyclictest0-21swapper/019:45:020
15955991310,2cyclictest0-21swapper/000:13:090
15955991310,2cyclictest0-21swapper/000:07:310
1595599130,2cyclictest31310-21diskmemload23:28:080
1595599130,2cyclictest0-21swapper/023:55:460
1595599130,2cyclictest0-21swapper/023:30:090
1595599130,2cyclictest0-21swapper/022:48:290
1595599130,2cyclictest0-21swapper/022:08:440
1595599130,2cyclictest0-21swapper/000:36:290
1595599130,12cyclictest0-21swapper/023:43:490
1595599130,12cyclictest0-21swapper/023:35:490
1595599130,12cyclictest0-21swapper/023:35:480
1595599130,12cyclictest0-21swapper/022:17:090
1595599130,12cyclictest0-21swapper/021:20:160
1595599130,12cyclictest0-21swapper/021:17:290
323502120,2sleep10-21swapper/119:50:071
1595899129,2cyclictest0-21swapper/319:55:103
1595899129,2cyclictest0-21swapper/319:35:123
1595899129,2cyclictest0-21swapper/300:35:543
1595899127,3cyclictest16044-21tr20:30:133
1595899127,3cyclictest14393-21ssh23:11:373
1595899120,2cyclictest0-21swapper/321:40:013
1595899120,2cyclictest0-21swapper/321:10:383
1595899120,2cyclictest0-21swapper/321:00:143
1595899120,2cyclictest0-21swapper/319:10:133
1595899120,11cyclictest0-21swapper/322:50:173
1595899120,11cyclictest0-21swapper/321:05:123
1595899120,11cyclictest0-21swapper/320:45:133
1595899120,11cyclictest0-21swapper/320:25:113
1595899120,11cyclictest0-21swapper/320:05:133
1595899120,11cyclictest0-21swapper/319:45:083
1595799129,2cyclictest31310-21diskmemload23:08:532
1595799129,2cyclictest29269-21kworker/u8:200:04:042
1595799129,2cyclictest18742-21kworker/u8:023:19:052
1595799129,2cyclictest16088-21kworker/u8:121:35:052
1595799129,2cyclictest10937-21kworker/u8:021:44:062
1595799129,2cyclictest0-21swapper/223:00:122
1595799129,2cyclictest0-21swapper/222:45:112
1595799129,2cyclictest0-21swapper/220:31:032
1595799120,2cyclictest19541-21ssh22:42:022
1595799120,11cyclictest0-21swapper/223:30:572
1595799120,11cyclictest0-21swapper/219:45:112
1595699129,2cyclictest31310-21diskmemload22:35:151
1595699129,2cyclictest207150irq/24-eth121:45:081
1595699129,2cyclictest0-21swapper/121:25:491
1595699129,2cyclictest0-21swapper/119:25:491
1595699127,3cyclictest15798-21munin-node1
1595699127,3cyclictest0-21swapper/121:55:121
1595699127,3cyclictest0-21swapper/120:50:131
1595699122,6cyclictest0-21swapper/119:20:001
1595699121,9cyclictest0-21swapper/120:36:001
1595699121,9cyclictest0-21swapper/120:35:591
1595699121,9cyclictest0-21swapper/119:40:111
1595699121,9cyclictest0-21swapper/119:10:171
1595699121,9cyclictest0-21swapper/100:20:501
1595699121,3cyclictest17085-21munin-node1
1595699121,3cyclictest0-21swapper/120:40:101
1595699121,2cyclictest26336-21perl00:00:151
1595699120,2cyclictest0-21swapper/122:30:521
1595699120,2cyclictest0-21swapper/122:02:471
1595699120,11cyclictest0-21swapper/123:58:221
1595699120,11cyclictest0-21swapper/123:41:261
1595699120,11cyclictest0-21swapper/123:00:151
1595699120,11cyclictest0-21swapper/120:06:021
1595699120,10cyclictest0-21swapper/121:01:021
1595599129,2cyclictest0-21swapper/022:40:310
1595599129,2cyclictest0-21swapper/022:21:410
1595599129,2cyclictest0-21swapper/022:00:190
1595599129,2cyclictest0-21swapper/020:45:100
1595599129,2cyclictest0-21swapper/019:16:040
1595599120,2cyclictest0-21swapper/022:58:220
1595599120,2cyclictest0-21swapper/022:51:030
1595599120,2cyclictest0-21swapper/020:00:130
1595599120,11cyclictest0-21swapper/023:47:160
1595599120,11cyclictest0-21swapper/023:47:150
1595599120,11cyclictest0-21swapper/023:01:290
1595599120,11cyclictest0-21swapper/019:30:130
1595599120,11cyclictest0-21swapper/000:30:150
1595799118,2cyclictest7171-21kworker/u8:121:16:052
1595799118,2cyclictest7171-21kworker/u8:120:37:052
1595799118,2cyclictest7171-21kworker/u8:120:37:042
1595799118,2cyclictest31310-21diskmemload22:11:002
1595799118,2cyclictest18742-21kworker/u8:023:23:042
1595799118,2cyclictest1484-21kworker/u8:019:55:042
1595799110,2cyclictest31310-21diskmemload00:38:312
1595799110,10cyclictest0-21swapper/200:16:102
1595699118,2cyclictest0-21swapper/119:55:121
1595699117,2cyclictest20207-21munin-node1
1595699117,2cyclictest0-21swapper/120:55:111
1595699116,3cyclictest11778-21munin-node1
1595699111,8cyclictest4694-21smartctl20:00:151
1595699111,8cyclictest0-21swapper/121:51:031
1595699111,3cyclictest21853-21munin-node1
1595699111,2cyclictest9750-21apt-get20:15:111
1595699110,9cyclictest0-21swapper/119:35:151
1595699110,3cyclictest0-21swapper/119:50:001
1595699110,3cyclictest0-21swapper/119:30:141
1595599111,2cyclictest24963-21mailstats20:51:000
1595599110,1cyclictest0-21swapper/020:40:120
1595599110,10cyclictest0-21swapper/023:51:080
125342110,7sleep231310-21diskmemload22:35:072
114822110,2sleep20-21swapper/223:44:402
1595899107,2cyclictest0-21swapper/320:10:213
1595899107,2cyclictest0-21swapper/319:51:013
1595899105,3cyclictest22845-21if_eth019:25:153
1595899102,7cyclictest0-21swapper/319:43:593
1595899101,6cyclictest0-21swapper/320:01:013
1595799107,2cyclictest23992-21kworker/u8:220:02:052
1595799107,2cyclictest19777-21kworker/u8:319:18:052
1595799107,2cyclictest0-21swapper/223:47:322
1595799107,2cyclictest0-21swapper/223:47:322
1595799107,2cyclictest0-21swapper/221:45:142
1595799107,2cyclictest0-21swapper/221:34:122
1595799106,3cyclictest29139-21kworker/u8:021:04:052
1595799100,9cyclictest0-21swapper/200:10:162
1595799100,2cyclictest0-21swapper/223:51:402
1595699107,2cyclictest0-21swapper/120:10:101
1595599107,2cyclictest0-21swapper/020:10:000
1595599107,2cyclictest0-21swapper/019:10:170
1595599104,5cyclictest0-21swapper/019:36:050
1595599100,8cyclictest274-21jbd2/sda1-820:30:170
134282100,2sleep20-21swapper/221:25:082
28525290,1sleep00-21swapper/021:00:300
159589996,2cyclictest0-21swapper/320:19:223
159589994,3cyclictest20698-21fschecks_time19:20:143
159589994,3cyclictest19144-21processes19:15:193
159579996,2cyclictest23992-21kworker/u8:220:14:042
159579994,3cyclictest8890-21cpu21:20:132
159579994,3cyclictest6604-21fschecks_time20:05:152
159579994,3cyclictest3728-21runrttasks20:54:332
159579994,3cyclictest3728-21runrttasks20:18:592
159579994,3cyclictest30978-21vmstat21:06:002
159579994,3cyclictest21363-21forks00:30:142
159579994,3cyclictest20116-21cut20:40:112
159579994,3cyclictest14212-21fschecks_count20:25:132
159579993,4cyclictest22364-21cut19:25:112
159579991,3cyclictest0-21swapper/220:59:482
159579991,3cyclictest0-21swapper/220:45:142
159579990,8cyclictest0-21swapper/221:12:212
159569993,4cyclictest29779-21tr21:05:101
159559996,2cyclictest0-21swapper/020:20:150
159559996,2cyclictest0-21swapper/019:56:040
159559996,2cyclictest0-21swapper/019:50:020
159559994,3cyclictest29773-21cpuspeed_turbos21:05:110
159559992,3cyclictest14059-21tr20:25:110
159559990,2cyclictest3649-21snmpd20:36:150
159559990,2cyclictest3649-21snmpd20:36:140
159589983,4cyclictest15954-21cyclictest20:55:153
159579983,3cyclictest16196-21aten2.4_r3power19:10:102
159559985,2cyclictest0-21swapper/020:55:120
159559983,3cyclictest8295-21egrep20:10:110
159559980,7cyclictest0-21swapper/020:16:020
159559980,6cyclictest22458-21tr19:25:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional