You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-12 - 07:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6s.osadl.org (updated Wed Aug 12, 2026 00:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
29951211490,19sleep00-21swapper/019:07:590
298402114103,6sleep10-21swapper/119:06:311
29908211291,16sleep20-21swapper/219:07:242
29992210897,6sleep30-21swapper/319:08:313
123362790,0sleep00-21swapper/023:18:330
123362790,0sleep00-21swapper/023:18:320
75162770,0sleep30-21swapper/300:19:013
98262760,0sleep00-21swapper/022:42:410
56662660,0sleep10-21swapper/123:11:051
30135993415,1cyclictest0-21swapper/122:00:131
92482300,1sleep29255-21sendmail_mailqu19:36:012
228462290,6sleep20-21swapper/221:50:282
3013799281,2cyclictest0-21swapper/321:25:123
30134992715,2cyclictest0-21swapper/021:55:120
3013499232,15cyclictest0-21swapper/021:25:000
3013499230,2cyclictest0-21swapper/021:53:220
3013499230,2cyclictest0-21swapper/000:13:450
18452230,1sleep337-21rcuc/322:02:033
156292230,0sleep20-21swapper/200:26:172
3013499220,2cyclictest0-21swapper/022:06:250
30137992117,2cyclictest0-21swapper/322:35:113
30135992118,2cyclictest28601-21kworker/u8:021:32:021
3013599211,18cyclictest0-21swapper/122:35:131
3013499212,17cyclictest0-21swapper/000:30:000
3013499211,9cyclictest30502-21taskset00:09:530
3013499211,18cyclictest23098-21sh00:01:110
3013499210,2cyclictest18355-21ssh22:51:150
3013499210,2cyclictest13938-21diskmemload23:42:470
3013499210,2cyclictest13938-21diskmemload00:23:220
3013499210,2cyclictest0-21swapper/022:48:560
3013499210,2cyclictest0-21swapper/022:34:150
3013499210,2cyclictest0-21swapper/022:16:040
3013499210,2cyclictest0-21swapper/022:13:150
3013499210,2cyclictest0-21swapper/021:47:470
3013499210,2cyclictest0-21swapper/021:05:150
3013699200,2cyclictest0-21swapper/223:35:122
30135992017,2cyclictest31290-21kworker/u8:123:31:041
30135992017,2cyclictest22123-21kworker/u8:221:24:051
30135992017,2cyclictest21166-21kworker/u8:223:44:051
30135992017,2cyclictest19221-21kworker/u8:122:22:021
30135992017,2cyclictest1701-21kworker/u8:221:59:051
30135992017,2cyclictest1701-21kworker/u8:221:54:041
3013599201,2cyclictest0-21swapper/122:44:041
3013599200,2cyclictest0-21swapper/122:05:111
3013599200,2cyclictest0-21swapper/121:39:051
3013499202,15cyclictest0-21swapper/020:37:020
3013499200,2cyclictest5994-21ssh23:11:230
3013499200,2cyclictest13938-21diskmemload22:20:550
3013499200,2cyclictest0-21swapper/023:50:140
3013499200,2cyclictest0-21swapper/023:45:180
3013499200,2cyclictest0-21swapper/023:35:100
3013499200,2cyclictest0-21swapper/023:30:220
3013499200,2cyclictest0-21swapper/023:24:070
3013499200,2cyclictest0-21swapper/023:24:060
3013499200,2cyclictest0-21swapper/023:06:220
3013499200,2cyclictest0-21swapper/023:01:510
3013499200,2cyclictest0-21swapper/022:55:500
3013499200,2cyclictest0-21swapper/022:35:470
3013499200,2cyclictest0-21swapper/022:26:270
3013499200,2cyclictest0-21swapper/021:44:060
3013499200,2cyclictest0-21swapper/021:35:390
3013499200,2cyclictest0-21swapper/021:31:580
3013499200,2cyclictest0-21swapper/021:25:270
3013499200,2cyclictest0-21swapper/021:15:180
3013499200,2cyclictest0-21swapper/021:10:110
3013499200,2cyclictest0-21swapper/020:26:020
3013499200,2cyclictest0-21swapper/000:35:150
3013499200,2cyclictest0-21swapper/000:33:110
3013499200,2cyclictest0-21swapper/000:16:590
3013499200,18cyclictest0-21swapper/021:00:160
3013499200,18cyclictest0-21swapper/020:46:040
3013499200,12cyclictest0-21swapper/019:20:160
47592190,1sleep30-21swapper/320:45:173
3013799190,16cyclictest0-21swapper/320:35:143
30136991916,2cyclictest31290-21kworker/u8:123:18:052
30136991916,2cyclictest31290-21kworker/u8:123:18:042
30135991916,2cyclictest7389-21kworker/u8:019:46:051
30135991916,2cyclictest7389-21kworker/u8:019:46:051
30135991916,2cyclictest31029-21kworker/u8:000:24:041
30135991916,2cyclictest20040-21kworker/u8:223:07:041
30135991916,2cyclictest17722-21kworker/u8:100:05:051
3013599190,14cyclictest0-21swapper/123:54:051
3013599190,14cyclictest0-21swapper/121:17:041
3013499192,14cyclictest0-21swapper/019:29:020
3013499190,2cyclictest0-21swapper/023:55:260
3013499190,2cyclictest0-21swapper/023:25:270
3013499190,2cyclictest0-21swapper/022:00:350
3013499190,2cyclictest0-21swapper/020:56:030
3013499190,2cyclictest0-21swapper/020:54:060
3013499190,2cyclictest0-21swapper/020:43:540
3013499190,2cyclictest0-21swapper/020:33:270
3013499190,2cyclictest0-21swapper/020:20:150
3013499190,2cyclictest0-21swapper/020:00:140
3013499190,2cyclictest0-21swapper/019:56:030
3013499190,2cyclictest0-21swapper/019:44:220
3013499190,2cyclictest0-21swapper/019:30:140
3013499190,2cyclictest0-21swapper/019:10:110
30136991815,2cyclictest5295-21kworker/u8:023:53:052
30135991815,2cyclictest6467-21kworker/u8:100:38:041
30135991815,2cyclictest21166-21kworker/u8:223:37:051
30135991815,2cyclictest21166-21kworker/u8:223:28:051
30135991815,2cyclictest20040-21kworker/u8:223:02:051
30135991815,2cyclictest17722-21kworker/u8:123:57:041
3013599180,2cyclictest0-21swapper/121:29:041
3013599180,2cyclictest0-21swapper/100:28:051
3013599180,13cyclictest0-21swapper/119:11:051
3013499180,2cyclictest0-21swapper/020:15:300
3013499180,2cyclictest0-21swapper/020:12:430
3013499180,2cyclictest0-21swapper/019:45:270
3013499180,2cyclictest0-21swapper/019:45:270
3013499180,2cyclictest0-21swapper/019:17:070
3013499180,1cyclictest0-21swapper/019:50:140
3013499180,1cyclictest0-21swapper/019:35:150
3013799171,14cyclictest24951-21iostat_ios21:20:193
3013799171,13cyclictest0-21swapper/322:25:083
30136991714,2cyclictest31029-21kworker/u8:000:30:042
30136991714,2cyclictest28601-21kworker/u8:021:38:052
30136991714,2cyclictest26527-21kworker/u8:122:07:052
3013699170,2cyclictest0-21swapper/222:44:042
30135991714,2cyclictest2056-21kworker/u8:119:26:021
3013599170,2cyclictest0-21swapper/122:13:051
3013599170,2cyclictest0-21swapper/100:10:041
3013599170,2cyclictest0-21swapper/100:03:051
3013599170,15cyclictest0-21swapper/123:15:051
3013599170,15cyclictest0-21swapper/123:15:041
3013499170,2cyclictest0-21swapper/020:05:270
3013799161,13cyclictest26718-21iostat_ios00:05:183
30137991611,3cyclictest0-21swapper/321:43:523
3013799160,14cyclictest21358-21ssh00:32:283
3013799160,14cyclictest13938-21diskmemload23:10:193
30136991613,2cyclictest22123-21kworker/u8:221:22:052
30136991613,2cyclictest21166-21kworker/u8:223:34:042
30136991613,2cyclictest19221-21kworker/u8:122:53:042
30136991613,2cyclictest19221-21kworker/u8:122:49:052
30136991613,2cyclictest17722-21kworker/u8:123:58:042
30136991613,2cyclictest1701-21kworker/u8:222:02:042
30136991612,2cyclictest13938-21diskmemload21:55:122
30135991613,2cyclictest31290-21kworker/u8:123:20:051
30135991613,2cyclictest31290-21kworker/u8:123:20:041
30135991613,2cyclictest30384-21kworker/u8:019:20:051
30135991613,2cyclictest13030-21kworker/u8:321:47:051
3013599160,2cyclictest0-21swapper/122:47:051
216502160,0sleep20-21swapper/222:55:142
30137991510,3cyclictest3885-21ssh21:31:193
30137991510,3cyclictest17038-21sendmail-mta23:24:233
30137991510,3cyclictest17038-21sendmail-mta23:24:223
30137991510,3cyclictest0-21swapper/322:43:223
3013799150,3cyclictest17792-21switchtime23:56:043
3013799150,3cyclictest15475-21users00:26:053
3013799150,13cyclictest0-21swapper/323:50:123
30136991512,2cyclictest6467-21kworker/u8:100:22:042
30136991512,2cyclictest30441-21kworker/u8:020:41:052
30136991512,2cyclictest25785-21kworker/u8:220:24:052
30136991512,2cyclictest19221-21kworker/u8:122:36:022
30136991512,2cyclictest1701-21kworker/u8:221:45:052
3013699150,3cyclictest0-21swapper/220:20:012
3013699150,13cyclictest0-21swapper/222:25:082
3013699150,13cyclictest0-21swapper/221:31:242
3013599153,7cyclictest0-21swapper/119:56:051
30135991512,2cyclictest13806-21kworker/u8:119:54:041
30135991512,2cyclictest0-21swapper/122:52:521
3013599150,2cyclictest32336-21runrttasks20:35:051
3013599150,2cyclictest0-21swapper/100:33:051
3013799149,3cyclictest9249-21ssh22:10:093
30137991411,2cyclictest0-21swapper/323:06:193
30137991411,2cyclictest0-21swapper/321:46:393
30137991410,2cyclictest6174-21munin-node3
3013799140,2cyclictest0-21swapper/323:32:183
3013799140,2cyclictest0-21swapper/322:31:593
3013799140,13cyclictest0-21swapper/322:59:193
3013799140,12cyclictest0-21swapper/323:17:133
3013799140,12cyclictest0-21swapper/323:17:123
3013799140,12cyclictest0-21swapper/323:00:413
30136991411,2cyclictest32048-21kworker/u8:123:42:042
30136991411,2cyclictest22346-21kworker/u8:120:14:042
30136991411,2cyclictest20040-21kworker/u8:223:12:052
30136991411,2cyclictest20040-21kworker/u8:223:05:042
30136991411,2cyclictest15982-21kworker/u8:019:55:052
30136991411,2cyclictest0-21swapper/223:47:132
30136991411,2cyclictest0-21swapper/223:02:142
30136991410,2cyclictest12586-21diskstats19:45:142
30136991410,2cyclictest12586-21diskstats19:45:132
3013699140,2cyclictest30348-21apt-get19:10:112
3013699140,13cyclictest0-21swapper/223:29:142
3013699140,13cyclictest0-21swapper/222:30:142
3013699140,13cyclictest0-21swapper/222:15:022
3013699140,13cyclictest0-21swapper/221:40:032
3013699140,12cyclictest23422-21sh00:35:132
3013699140,12cyclictest0-21swapper/221:15:552
3013699140,12cyclictest0-21swapper/200:15:152
3013599142,2cyclictest0-21swapper/121:41:041
30135991411,2cyclictest32420-21kworker/u8:222:33:041
30135991411,2cyclictest25785-21kworker/u8:220:25:041
30135991411,2cyclictest13938-21diskmemload22:58:031
3013599140,2cyclictest0-21swapper/121:01:041
3013599140,10cyclictest0-21swapper/122:25:051
3013799132,6cyclictest20884-21rm22:21:013
3013799131,6cyclictest0-21swapper/320:05:003
30137991310,2cyclictest13938-21diskmemload00:12:193
30137991310,2cyclictest0-21swapper/323:39:093
30137991310,2cyclictest0-21swapper/321:51:013
30137991310,2cyclictest0-21swapper/321:36:183
30137991310,2cyclictest0-21swapper/321:10:593
30137991310,2cyclictest0-21swapper/320:06:093
3013799130,2cyclictest0-21swapper/322:50:163
3013799130,2cyclictest0-21swapper/322:17:213
3013799130,12cyclictest0-21swapper/300:39:093
3013799130,11cyclictest0-21swapper/323:26:033
30136991310,2cyclictest9891-21kworker/u8:121:28:042
30136991310,2cyclictest9849-21kworker/u8:220:02:042
30136991310,2cyclictest29403-21ssh00:08:132
30136991310,2cyclictest15982-21kworker/u8:020:08:052
30136991310,2cyclictest0-21swapper/222:20:352
30136991310,2cyclictest0-21swapper/222:13:052
30136991310,2cyclictest0-21swapper/221:14:242
30136991310,2cyclictest0-21swapper/221:00:152
30136991310,2cyclictest0-21swapper/200:00:182
3013699130,2cyclictest0-21swapper/220:55:152
3013699130,12cyclictest0-21swapper/223:22:442
3013699130,12cyclictest0-21swapper/223:22:432
3013599138,3cyclictest15182-21sh22:15:181
30135991310,2cyclictest7389-21kworker/u8:019:42:011
30135991310,2cyclictest6205-21kworker/u8:220:54:041
30135991310,2cyclictest5295-21kworker/u8:023:45:041
30135991310,2cyclictest30441-21kworker/u8:021:05:041
30135991310,2cyclictest30441-21kworker/u8:020:42:041
30135991310,2cyclictest30441-21kworker/u8:020:32:051
30135991310,2cyclictest1945-21kworker/u8:120:49:051
30135991310,2cyclictest0-21swapper/120:55:151
3013599130,8cyclictest0-21swapper/120:12:051
3013599130,2cyclictest0-21swapper/121:13:031
3013799129,2cyclictest0-21swapper/323:42:023
3013799129,2cyclictest0-21swapper/322:45:123
3013799129,2cyclictest0-21swapper/322:06:423
3013799129,2cyclictest0-21swapper/320:30:183
3013799129,2cyclictest0-21swapper/319:11:033
3013799129,2cyclictest0-21swapper/300:00:023
3013799121,9cyclictest27974-21taskset20:23:253
3013799120,2cyclictest0-21swapper/321:55:513
3013799120,2cyclictest0-21swapper/321:17:023
3013799120,2cyclictest0-21swapper/320:55:313
3013799120,11cyclictest0-21swapper/320:40:023
3013799120,11cyclictest0-21swapper/300:23:313
3013699129,2cyclictest0-21swapper/219:31:042
3013699122,7cyclictest0-21swapper/219:23:022
3013699120,2cyclictest0-21swapper/221:05:322
3013699120,11cyclictest0-21swapper/200:13:112
3013599129,2cyclictest7389-21kworker/u8:019:36:051
3013599129,2cyclictest31029-21kworker/u8:000:15:051
3013599121,9cyclictest32353-21munin-node1
3013799118,2cyclictest0-21swapper/321:03:113
3013799118,2cyclictest0-21swapper/320:14:203
3013799110,10cyclictest0-21swapper/319:51:143
3013799110,10cyclictest0-21swapper/319:23:393
3013699118,2cyclictest30441-21kworker/u8:020:52:042
3013699118,2cyclictest25785-21kworker/u8:220:36:052
3013699118,2cyclictest0-21swapper/220:31:072
3013699118,2cyclictest0-21swapper/219:40:172
3013699110,10cyclictest0-21swapper/220:49:452
3013599118,2cyclictest15982-21kworker/u8:020:09:051
3013599110,3cyclictest18266-21munin-node1
3013599110,3cyclictest0-21swapper/120:21:041
3013799107,2cyclictest0-21swapper/319:56:023
3013799107,2cyclictest0-21swapper/319:34:293
3013799105,3cyclictest3728-21runrttasks19:42:183
3013799105,3cyclictest24593-21df20:15:153
3013799105,3cyclictest12350-21telnet19:45:133
3013799105,3cyclictest12350-21telnet19:45:123
3013799102,7cyclictest0-21swapper/321:07:023
3013699107,2cyclictest0-21swapper/219:50:542
3013699102,7cyclictest0-21swapper/220:25:012
3013699102,7cyclictest0-21swapper/219:15:012
3013699100,9cyclictest0-21swapper/219:27:142
3013599107,2cyclictest7430-21timerandwakeup19:31:021
3013599100,2cyclictest0-21swapper/120:15:151
301379994,3cyclictest8281-21aten2.4-expect19:35:133
301379994,3cyclictest3817-21latency_hist19:25:003
301379990,2cyclictest0-21swapper/319:17:513
301379983,3cyclictest3728-21runrttasks20:51:543
301379983,3cyclictest28529-21cpu20:25:143
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional