You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-05 - 03:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Wed Aug 05, 2026 00:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
12880211794,18sleep00-21swapper/019:09:590
12101211392,16sleep20-21swapper/219:05:212
12800211194,12sleep30-21swapper/319:08:593
12023210380,16sleep10-21swapper/119:05:201
135912820,0sleep00-21swapper/019:10:150
238072810,0sleep10-21swapper/119:35:151
82832730,0sleep00-21swapper/023:00:400
311872730,1sleep2301ktimersoftd/222:17:292
123272710,1sleep10-21swapper/121:58:281
227482700,0sleep20-21swapper/221:35:342
162362320,0sleep20-21swapper/223:09:482
136802310,1sleep1221ktimersoftd/123:40:151
221782260,0sleep00-21swapper/000:22:290
215322230,1sleep20-21swapper/223:15:152
1290999230,17cyclictest0-21swapper/200:02:052
12909992117,2cyclictest0-21swapper/219:55:122
1290999211,16cyclictest0-21swapper/219:24:052
1290999210,4cyclictest0-21swapper/220:14:042
1290999210,19cyclictest0-21swapper/222:55:132
1291099201,2cyclictest29008-21diskmemload22:20:163
12909992017,2cyclictest31565-21kworker/u8:000:12:042
12909992017,2cyclictest31349-21kworker/u8:021:49:052
12909992017,2cyclictest24247-21kworker/u8:200:38:012
1290999200,5cyclictest0-21swapper/220:25:042
1290999200,4cyclictest0-21swapper/219:52:012
12908992017,2cyclictest31349-21kworker/u8:022:03:051
1290799200,18cyclictest0-21swapper/022:55:130
1291099191,16cyclictest0-21swapper/322:25:123
12909991916,2cyclictest7071-21kworker/u8:123:04:052
12909991916,2cyclictest31695-21kworker/u8:222:42:062
12909991916,2cyclictest31695-21kworker/u8:222:42:052
12909991916,2cyclictest31565-21kworker/u8:000:23:042
12909991916,2cyclictest31349-21kworker/u8:022:22:062
12909991916,2cyclictest2363-21kworker/u8:023:33:042
1290999190,3cyclictest0-21swapper/223:52:052
1290999190,3cyclictest0-21swapper/220:42:042
1290799190,17cyclictest0-21swapper/022:15:110
12909991815,2cyclictest31695-21kworker/u8:222:28:012
12909991815,2cyclictest26463-21kworker/u8:122:50:052
12909991815,2cyclictest15855-21kworker/u8:223:45:042
12908991815,2cyclictest573-21kworker/u8:223:13:041
173382170,0sleep30-21swapper/323:44:293
12910991713,2cyclictest29184-21sort23:56:033
12909991714,2cyclictest4746-21kworker/u8:321:24:052
12909991714,2cyclictest2529-21kworker/u8:020:20:052
12909991714,2cyclictest2529-21kworker/u8:020:08:042
12909991714,2cyclictest13255-21kworker/u8:022:47:042
12909991714,2cyclictest13255-21kworker/u8:022:47:042
1290999171,12cyclictest27821-21kworker/2:219:11:042
1290999170,4cyclictest0-21swapper/219:19:042
1290999170,2cyclictest0-21swapper/223:14:042
1290999170,2cyclictest0-21swapper/222:07:042
35052160,1sleep30-21swapper/300:36:353
12909991613,2cyclictest7842-21kworker/u8:221:59:042
12909991613,2cyclictest5572-21kworker/u8:122:30:042
12909991613,2cyclictest4746-21kworker/u8:321:31:042
12909991613,2cyclictest31565-21kworker/u8:000:08:042
12909991613,2cyclictest24744-21kworker/u8:119:44:042
12909991613,2cyclictest24247-21kworker/u8:200:27:052
12909991613,2cyclictest24172-21kworker/u8:323:23:042
12909991613,2cyclictest23281-21kworker/u8:021:09:042
12909991613,2cyclictest14842-21kworker/u8:219:35:042
12909991613,2cyclictest13548-21kworker/u8:122:00:052
12909991613,2cyclictest10689-21kworker/u8:120:35:042
1290999161,13cyclictest0-21swapper/200:15:172
12908991613,2cyclictest573-21kworker/u8:223:02:021
12908991613,2cyclictest4746-21kworker/u8:321:42:051
12908991613,2cyclictest4746-21kworker/u8:321:22:051
12908991613,2cyclictest25716-21kworker/u8:323:56:041
12908991613,2cyclictest2363-21kworker/u8:023:31:041
12908991612,2cyclictest29008-21diskmemload00:12:041
1290799160,14cyclictest0-21swapper/022:35:170
12910991512,2cyclictest0-21swapper/322:35:583
12910991511,2cyclictest15468-21processes00:15:193
12910991510,3cyclictest3073-21ssh21:49:303
1291099150,13cyclictest0-21swapper/319:25:183
1290999152,7cyclictest0-21swapper/221:15:012
12909991512,2cyclictest8482-21kworker/u8:123:38:042
12909991512,2cyclictest31349-21kworker/u8:021:50:042
12909991512,2cyclictest24744-21kworker/u8:120:00:042
12909991512,2cyclictest23281-21kworker/u8:020:56:052
12909991512,2cyclictest14842-21kworker/u8:219:47:052
12909991512,2cyclictest14842-21kworker/u8:219:32:052
1290999150,13cyclictest0-21swapper/222:10:162
12908991512,2cyclictest31695-21kworker/u8:222:20:041
12908991512,2cyclictest11820-21kworker/u8:121:27:041
12908991510,3cyclictest0-21swapper/120:45:131
1290899150,2cyclictest0-21swapper/120:25:041
1290899150,13cyclictest0-21swapper/119:25:151
1290799151,12cyclictest13850-21ssh23:06:090
12907991510,3cyclictest27779-21ssh23:55:140
1290799150,13cyclictest0-21swapper/022:40:130
1290799150,13cyclictest0-21swapper/022:40:130
1291099142,6cyclictest0-21swapper/320:00:013
1291099142,2cyclictest0-21swapper/300:14:233
1291099141,2cyclictest29008-21diskmemload23:36:093
12910991411,2cyclictest381ktimersoftd/323:15:333
12910991411,2cyclictest0-21swapper/323:33:093
1291099141,11cyclictest381ktimersoftd/322:46:513
1291099141,11cyclictest381ktimersoftd/322:46:503
1291099141,11cyclictest0-21swapper/321:15:333
12910991410,2cyclictest0-21swapper/321:57:233
1291099140,13cyclictest0-21swapper/323:27:003
1291099140,12cyclictest0-21swapper/323:51:523
1291099140,12cyclictest0-21swapper/323:03:123
1291099140,12cyclictest0-21swapper/322:30:183
1291099140,12cyclictest0-21swapper/321:26:123
1291099140,12cyclictest0-21swapper/319:11:043
1290999149,3cyclictest0-21swapper/220:50:172
1290999142,8cyclictest8892-21copy20:19:592
1290999142,7cyclictest0-21swapper/223:59:592
1290999141,2cyclictest29008-21diskmemload23:29:272
12909991411,2cyclictest31565-21kworker/u8:000:34:042
12909991411,2cyclictest10689-21kworker/u8:120:47:052
1290999140,2cyclictest0-21swapper/221:26:042
12908991411,2cyclictest5572-21kworker/u8:122:32:041
12908991411,2cyclictest4746-21kworker/u8:321:35:051
12908991411,2cyclictest31695-21kworker/u8:222:43:041
12908991411,2cyclictest31695-21kworker/u8:222:43:041
12908991411,2cyclictest31695-21kworker/u8:222:28:061
12908991411,2cyclictest13255-21kworker/u8:022:37:051
12908991410,2cyclictest0-21swapper/121:54:491
1290899140,12cyclictest0-21swapper/121:10:241
1290899140,12cyclictest0-21swapper/120:10:141
1290899140,12cyclictest0-21swapper/119:40:211
1290899140,12cyclictest0-21swapper/100:37:211
1290899140,12cyclictest0-21swapper/100:03:361
12907991410,2cyclictest15211-21cat00:15:180
1290799140,12cyclictest0-21swapper/023:37:060
250642130,9sleep029008-21diskmemload22:11:030
1291099133,7cyclictest0-21swapper/319:20:013
1291099132,6cyclictest0-21swapper/321:55:003
1291099132,6cyclictest0-21swapper/320:54:593
12910991311,1cyclictest0-21swapper/321:44:193
12910991310,2cyclictest381ktimersoftd/323:47:083
12910991310,2cyclictest0-21swapper/322:00:003
12910991310,2cyclictest0-21swapper/321:21:023
12910991310,2cyclictest0-21swapper/320:45:153
12910991310,2cyclictest0-21swapper/320:21:173
12910991310,2cyclictest0-21swapper/319:40:203
12910991310,2cyclictest0-21swapper/300:20:143
12910991310,2cyclictest0-21swapper/300:06:513
1291099130,2cyclictest0-21swapper/323:20:593
1291099130,2cyclictest0-21swapper/323:10:143
1291099130,2cyclictest0-21swapper/323:07:303
1291099130,2cyclictest0-21swapper/322:13:343
1291099130,2cyclictest0-21swapper/321:10:083
1291099130,2cyclictest0-21swapper/320:40:163
1291099130,2cyclictest0-21swapper/300:25:143
1291099130,2cyclictest0-21swapper/300:04:503
1291099130,12cyclictest0-21swapper/322:42:123
1291099130,12cyclictest0-21swapper/322:42:113
1291099130,12cyclictest0-21swapper/322:19:203
1291099130,12cyclictest0-21swapper/300:32:593
1291099130,11cyclictest29008-21diskmemload22:52:233
12909991310,2cyclictest25209-21apt-get21:00:122
1290999130,12cyclictest0-21swapper/220:31:042
1290999130,11cyclictest0-21swapper/222:36:282
1290899139,2cyclictest0-21swapper/121:48:501
1290899136,5cyclictest0-21swapper/100:15:591
12908991310,2cyclictest573-21kworker/u8:222:54:061
12908991310,2cyclictest31695-21kworker/u8:222:19:041
12908991310,2cyclictest31565-21kworker/u8:000:24:011
12908991310,2cyclictest24247-21kworker/u8:200:32:011
12908991310,2cyclictest24172-21kworker/u8:323:26:051
12908991310,2cyclictest2363-21kworker/u8:023:46:011
12908991310,2cyclictest23281-21kworker/u8:021:18:041
12908991310,2cyclictest0-21swapper/123:23:351
12908991310,2cyclictest0-21swapper/100:07:161
1290899130,2cyclictest5014-21ssh22:57:331
1290899130,2cyclictest17644-21fschecks_time19:20:171
1290899130,2cyclictest0-21swapper/123:15:051
1290899130,12cyclictest0-21swapper/120:20:141
1290899130,11cyclictest0-21swapper/120:30:501
1290799139,2cyclictest0-21swapper/022:30:170
12907991310,2cyclictest0-21swapper/023:50:570
12907991310,2cyclictest0-21swapper/023:29:260
12907991310,2cyclictest0-21swapper/021:56:040
1290799130,3cyclictest15198-21ssh21:28:190
1290799130,2cyclictest2004-21ssh21:47:540
1290799130,2cyclictest0-21swapper/021:31:010
1290799130,12cyclictest17518-21ssh23:44:470
1290799130,12cyclictest0-21swapper/022:20:500
1290799130,11cyclictest0-21swapper/022:45:090
1290799130,11cyclictest0-21swapper/022:45:080
1290799130,11cyclictest0-21swapper/000:35:350
1290799130,11cyclictest0-21swapper/000:31:340
1291099129,2cyclictest381ktimersoftd/321:31:253
1291099129,2cyclictest381ktimersoftd/320:30:413
1291099129,2cyclictest0-21swapper/322:05:023
1291099129,2cyclictest0-21swapper/321:35:023
1291099129,2cyclictest0-21swapper/320:55:173
1291099120,2cyclictest381ktimersoftd/322:56:053
1291099120,11cyclictest39-21ksoftirqd/319:30:133
1291099120,11cyclictest0-21swapper/321:01:053
1291099120,11cyclictest0-21swapper/320:13:053
1290999129,2cyclictest29008-21diskmemload21:40:142
1290999127,3cyclictest0-21swapper/221:16:192
1290999120,11cyclictest0-21swapper/223:40:012
1290899129,2cyclictest31349-21kworker/u8:022:12:051
1290899124,5cyclictest0-21swapper/119:54:581
1290899122,7cyclictest0-21swapper/120:42:581
1290899120,2cyclictest0-21swapper/122:05:191
1290899120,2cyclictest0-21swapper/121:34:381
1290899120,2cyclictest0-21swapper/119:10:291
1290899120,11cyclictest0-21swapper/123:50:241
1290899120,11cyclictest0-21swapper/123:35:061
1290899120,11cyclictest0-21swapper/123:06:041
1290899120,11cyclictest0-21swapper/122:45:041
1290899120,11cyclictest0-21swapper/122:45:041
1290899120,11cyclictest0-21swapper/121:00:131
1290899120,11cyclictest0-21swapper/119:45:141
1290899120,11cyclictest0-21swapper/100:25:171
1290799129,2cyclictest0-21swapper/023:45:050
1290799129,2cyclictest0-21swapper/022:50:550
1290799129,2cyclictest0-21swapper/000:25:040
1290799129,2cyclictest0-21swapper/000:00:380
1290799128,2cyclictest3124-21apt-get23:30:050
1290799121,9cyclictest3649-21snmpd20:50:000
1290799120,2cyclictest3746-21munin-node0
1290799120,2cyclictest0-21swapper/023:21:550
1290799120,2cyclictest0-21swapper/022:25:200
1290799120,2cyclictest0-21swapper/021:36:050
1290799120,2cyclictest0-21swapper/000:11:470
1290799120,11cyclictest21227-21ssh23:15:090
1290799120,11cyclictest0-21swapper/023:10:190
1290799120,11cyclictest0-21swapper/022:06:240
1290799120,11cyclictest0-21swapper/022:00:560
1290799120,11cyclictest0-21swapper/021:42:400
1290799120,11cyclictest0-21swapper/021:20:190
1290799120,10cyclictest0-21swapper/000:05:070
1291099112,7cyclictest0-21swapper/320:02:583
1291099111,7cyclictest27249-21munin-node3
1291099111,7cyclictest0-21swapper/320:38:583
1291099111,6cyclictest0-21swapper/321:06:033
1290899118,2cyclictest2529-21kworker/u8:020:05:041
1290899118,2cyclictest2529-21kworker/u8:020:04:041
1290899118,2cyclictest23281-21kworker/u8:021:08:041
1290899118,2cyclictest0-21swapper/120:35:401
1290899118,2cyclictest0-21swapper/119:30:171
1290899118,2cyclictest0-21swapper/119:15:151
1290899112,7cyclictest0-21swapper/120:18:011
1290899112,6cyclictest0-21swapper/119:57:591
1290899110,9cyclictest0-21swapper/120:55:161
1290799112,6cyclictest0-21swapper/020:35:240
1290799111,6cyclictest0-21swapper/020:30:220
1290799111,6cyclictest0-21swapper/019:55:110
1290799110,9cyclictest0-21swapper/020:15:000
1291099107,2cyclictest0-21swapper/319:15:173
1291099106,3cyclictest0-21swapper/320:16:023
1291099101,7cyclictest0-21swapper/320:26:013
1290999100,2cyclictest0-21swapper/219:27:042
1290799102,6cyclictest0-21swapper/021:15:400
1290799102,6cyclictest0-21swapper/019:35:120
1290799102,6cyclictest0-21swapper/019:30:100
1290799101,7cyclictest0-21swapper/019:41:580
1290799101,6cyclictest0-21swapper/020:41:030
1290799101,6cyclictest0-21swapper/020:20:210
1290799101,6cyclictest0-21swapper/020:16:010
1290799101,5cyclictest0-21swapper/020:09:590
1290799101,5cyclictest0-21swapper/019:15:000
129109996,2cyclictest0-21swapper/320:05:123
129109996,2cyclictest0-21swapper/319:50:183
129109996,2cyclictest0-21swapper/319:35:083
129089996,2cyclictest0-21swapper/120:50:161
129079994,3cyclictest25566-21df_abs21:00:150
129079994,3cyclictest21267-21head20:50:140
129079994,3cyclictest11674-21tr20:25:150
129079992,6cyclictest0-21swapper/019:45:140
129079991,7cyclictest18952-21turbostat.cron19:25:010
129079991,6cyclictest0-21swapper/019:25:090
129079990,2cyclictest29008-21diskmemload21:10:400
129079990,2cyclictest0-21swapper/019:55:000
129079984,3cyclictest23462-21cpuspeed_turbos20:55:150
129079982,5cyclictest0-21swapper/021:07:580
129079981,6cyclictest0-21swapper/020:00:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional