You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-09 - 03:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Tue Dec 09, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
83222118107,6sleep30-21swapper/319:08:563
8054211497,12sleep20-21swapper/219:05:292
8126211188,17sleep10-21swapper/119:06:241
8324210779,6sleep00-21swapper/019:08:560
955721060,1sleep39556-21ssh22:36:433
256822850,0sleep30-21swapper/300:04:263
240522710,0sleep10-21swapper/122:52:361
245572520,1sleep224556-21ssh21:44:242
113932250,0sleep3381ktimersoftd/321:30:133
843899230,21cyclictest0-21swapper/300:20:123
206572230,1sleep20-21swapper/222:49:412
8437992219,2cyclictest20340-21kworker/u8:120:08:022
843899211,17cyclictest2709-21ssh23:05:143
8437992118,2cyclictest8260-21kworker/u8:119:11:042
843799202,2cyclictest28702-21copy20:00:012
843799202,2cyclictest0-21swapper/200:21:052
8437992017,2cyclictest26258-21kworker/u8:219:53:052
8437992017,2cyclictest20923-21kworker/u8:122:29:042
8437992017,2cyclictest20340-21kworker/u8:119:49:042
8437992017,2cyclictest14226-21kworker/u8:221:45:042
8437992016,2cyclictest22408-21kworker/u8:021:11:042
843799201,2cyclictest0-21swapper/221:15:052
843799201,17cyclictest0-21swapper/222:58:062
8435992017,2cyclictest26258-21kworker/u8:220:00:010
8435992017,2cyclictest22408-21kworker/u8:021:15:040
843899191,16cyclictest0-21swapper/323:10:123
843899190,17cyclictest0-21swapper/323:35:113
843799192,9cyclictest0-21swapper/200:37:042
8437991916,2cyclictest5853-21kworker/u8:100:29:042
8437991916,2cyclictest32425-21kworker/u8:222:09:052
8437991916,2cyclictest23364-21kworker/u8:123:27:042
8437991915,2cyclictest21157-21kworker/u8:323:16:042
843799191,2cyclictest2049-21ssh23:39:042
843799190,17cyclictest0-21swapper/223:21:042
843799190,17cyclictest0-21swapper/221:56:052
8435991916,2cyclictest29753-21kworker/u8:023:39:040
8435991916,2cyclictest29658-21kworker/u8:000:21:050
8435991916,2cyclictest21157-21kworker/u8:322:56:060
8435991916,2cyclictest17233-21kworker/u8:000:37:040
8437991815,2cyclictest21157-21kworker/u8:323:41:042
8437991815,2cyclictest1852-21kworker/u8:020:39:042
8437991815,2cyclictest1852-21kworker/u8:020:30:052
8437991815,2cyclictest12401-21kworker/u8:019:29:042
843799180,2cyclictest0-21swapper/220:44:052
843799180,2cyclictest0-21swapper/200:14:052
8435991815,2cyclictest5241-21kworker/u8:022:02:010
8435991815,2cyclictest29753-21kworker/u8:023:59:040
8435991815,2cyclictest29658-21kworker/u8:000:14:060
843899171,14cyclictest20803-21ssh23:59:053
843799170,2cyclictest0-21swapper/221:52:012
843799170,16cyclictest0-21swapper/219:16:012
843799170,15cyclictest0-21swapper/221:01:042
8435991714,2cyclictest6330-21kworker/u8:120:44:040
8435991714,2cyclictest25306-21kworker/u8:121:56:050
8435991714,2cyclictest19365-21kworker/u8:021:52:010
8435991714,2cyclictest1852-21kworker/u8:020:38:040
8435991714,2cyclictest1852-21kworker/u8:020:32:020
8435991714,2cyclictest15322-21kworker/u8:023:21:050
8435991712,3cyclictest790-21df_abs20:10:140
843899162,12cyclictest12829-21grep23:15:173
843899161,3cyclictest28610-21sendmail-msp20:00:003
843799160,5cyclictest0-21swapper/219:56:012
8435991613,2cyclictest3872-21kworker/u8:319:16:010
8435991613,2cyclictest29753-21kworker/u8:023:53:040
8435991613,2cyclictest21157-21kworker/u8:323:13:050
8435991613,2cyclictest20923-21kworker/u8:122:46:050
8435991613,2cyclictest20340-21kworker/u8:119:56:020
8435991613,2cyclictest20340-21kworker/u8:119:54:040
8435991613,2cyclictest16299-21kworker/u8:319:28:040
8435991611,3cyclictest24429-21kworker/u8:121:11:040
211222160,1sleep10-21swapper/123:25:001
843899152,7cyclictest0-21swapper/322:10:013
843899152,2cyclictest228042sleep321:05:133
8438991511,2cyclictest0-21swapper/322:24:353
843899150,13cyclictest0-21swapper/320:25:083
8437991512,2cyclictest5563-21kworker/u8:021:28:012
8437991512,2cyclictest29753-21kworker/u8:023:34:052
8437991512,2cyclictest19191-21kworker/u8:100:06:052
8437991511,3cyclictest5241-21kworker/u8:022:12:042
843799151,12cyclictest5010-21snmpd21:31:052
8437991511,2cyclictest4949-21kworker/u8:022:39:042
843799151,12cyclictest2038-21apt-get22:30:062
843799150,2cyclictest10689-21ssh23:13:042
843799150,2cyclictest0-21swapper/200:16:042
843799150,14cyclictest0-21swapper/219:34:012
8436991510,3cyclictest7771-21mailstats21:25:241
8436991510,3cyclictest31727-21iostat_ios00:10:181
843699150,13cyclictest6328-21date21:25:001
843699150,11cyclictest0-21swapper/122:20:571
8435991512,2cyclictest29753-21kworker/u8:000:02:040
8435991512,2cyclictest26258-21kworker/u8:220:16:040
8435991512,2cyclictest24599-21diskmemload00:09:530
8435991512,2cyclictest24545-21kworker/u8:200:16:040
8435991512,2cyclictest20923-21kworker/u8:122:37:040
8435991512,2cyclictest18430-21kworker/u8:020:55:050
8435991512,2cyclictest16327-21kworker/u8:221:01:040
8435991512,2cyclictest0-21swapper/021:22:050
843599150,13cyclictest0-21swapper/021:39:140
843899149,3cyclictest0-21swapper/323:50:163
843899142,7cyclictest2091-21copy22:30:003
843899142,7cyclictest0-21swapper/320:40:003
8438991411,2cyclictest0-21swapper/323:25:053
8438991411,2cyclictest0-21swapper/322:44:063
843899141,12cyclictest0-21swapper/321:52:453
8438991411,2cyclictest0-21swapper/321:36:153
8438991411,2cyclictest0-21swapper/321:26:563
8438991411,2cyclictest0-21swapper/320:45:253
8438991411,2cyclictest0-21swapper/320:05:253
843899140,2cyclictest0-21swapper/323:30:043
843899140,2cyclictest0-21swapper/322:00:253
843899140,2cyclictest0-21swapper/300:29:453
843899140,13cyclictest0-21swapper/321:14:553
843899140,13cyclictest0-21swapper/319:50:263
843899140,12cyclictest39-21ksoftirqd/320:50:183
843899140,12cyclictest381ktimersoftd/322:45:113
843899140,12cyclictest0-21swapper/322:30:283
843899140,12cyclictest0-21swapper/321:15:203
843899140,12cyclictest0-21swapper/300:35:143
8437991411,2cyclictest5241-21kworker/u8:022:17:042
8437991411,2cyclictest13642-21kworker/u8:222:41:042
843799140,2cyclictest22358-21ssh22:50:262
843799140,2cyclictest0-21swapper/222:00:562
843799140,2cyclictest0-21swapper/200:04:052
843799140,13cyclictest0-21swapper/223:50:262
843799140,12cyclictest20897-21ssh00:33:422
843799140,12cyclictest0-21swapper/223:03:042
843799140,12cyclictest0-21swapper/221:23:032
843699149,3cyclictest19923-21ssh22:13:571
8436991410,2cyclictest0-21swapper/100:20:161
843699140,2cyclictest0-21swapper/122:33:501
843699140,12cyclictest0-21swapper/123:40:191
843699140,12cyclictest0-21swapper/122:57:461
843699140,12cyclictest0-21swapper/120:05:271
843699140,12cyclictest0-21swapper/100:32:181
843699140,12cyclictest0-21swapper/100:25:181
8435991411,2cyclictest12401-21kworker/u8:019:34:010
8435991411,2cyclictest0-21swapper/022:52:440
8435991411,2cyclictest0-21swapper/022:40:040
843599140,13cyclictest0-21swapper/021:41:040
843599140,12cyclictest17880-21ssh22:10:330
843599140,12cyclictest0-21swapper/023:15:540
843599140,12cyclictest0-21swapper/022:18:250
61242140,2sleep00-21swapper/023:42:430
843899139,2cyclictest0-21swapper/323:40:263
843899131,2cyclictest381ktimersoftd/322:17:183
843899131,11cyclictest0-21swapper/319:10:283
8438991310,2cyclictest37-21rcuc/323:03:203
8438991310,2cyclictest0-21swapper/300:15:143
843899130,2cyclictest0-21swapper/319:35:113
843899130,2cyclictest0-21swapper/319:15:273
843899130,2cyclictest0-21swapper/300:09:143
843899130,12cyclictest0-21swapper/321:56:353
843899130,11cyclictest0-21swapper/300:13:273
8437991310,2cyclictest22408-21kworker/u8:021:07:052
8437991310,2cyclictest20371-21kworker/u8:320:59:042
8437991310,2cyclictest16299-21kworker/u8:319:41:052
8437991310,2cyclictest16299-21kworker/u8:319:41:042
8437991310,2cyclictest0-21swapper/223:45:142
8437991310,2cyclictest0-21swapper/223:05:272
843799130,2cyclictest0-21swapper/221:37:512
843799130,2cyclictest0-21swapper/220:28:042
843799130,12cyclictest0-21swapper/222:20:002
843699138,3cyclictest6455-21cat20:25:001
843699131,8cyclictest24599-21diskmemload22:00:231
843699130,2cyclictest30789-21smartctl21:15:261
843699130,2cyclictest24599-21diskmemload23:53:391
843699130,2cyclictest24599-21diskmemload22:09:491
843699130,2cyclictest0-21swapper/123:45:281
843699130,2cyclictest0-21swapper/122:45:161
843699130,2cyclictest0-21swapper/121:45:591
843699130,2cyclictest0-21swapper/121:45:001
843699130,12cyclictest0-21swapper/100:19:581
843699130,11cyclictest24599-21diskmemload00:09:281
843699130,11cyclictest0-21swapper/119:45:191
8435991310,2cyclictest6330-21kworker/u8:120:28:040
8435991310,2cyclictest24599-21diskmemload22:32:400
8435991310,2cyclictest24599-21diskmemload21:25:060
8435991310,2cyclictest22408-21kworker/u8:021:08:020
8435991310,2cyclictest0-21swapper/023:46:560
8435991310,2cyclictest0-21swapper/023:30:280
8435991310,2cyclictest0-21swapper/023:06:380
8435991310,2cyclictest0-21swapper/023:00:480
8435991310,2cyclictest0-21swapper/022:25:080
8435991310,2cyclictest0-21swapper/022:20:550
8435991310,2cyclictest0-21swapper/022:08:180
8435991310,2cyclictest0-21swapper/019:45:250
8435991310,2cyclictest0-21swapper/000:34:080
843599130,2cyclictest24599-21diskmemload21:30:550
843599130,2cyclictest0-21swapper/021:47:250
843599130,12cyclictest0-21swapper/023:25:040
843599130,12cyclictest0-21swapper/019:40:230
843599130,12cyclictest0-21swapper/019:40:220
326662130,2sleep10-21swapper/123:36:031
293782130,1sleep10-21swapper/120:00:161
199752130,2sleep10-21swapper/123:57:441
196692130,3sleep219678-21ssh23:57:132
843899129,2cyclictest0-21swapper/323:20:083
843899129,2cyclictest0-21swapper/322:50:553
843899129,2cyclictest0-21swapper/321:20:293
843899127,3cyclictest25839-21ssh22:55:143
843899127,3cyclictest0-21swapper/320:00:063
843899121,10cyclictest0-21swapper/323:47:003
843899120,2cyclictest381ktimersoftd/321:40:483
843899120,2cyclictest0-21swapper/300:31:253
843899120,11cyclictest0-21swapper/322:13:123
843899120,11cyclictest0-21swapper/321:45:053
843899120,11cyclictest0-21swapper/320:15:173
843899120,11cyclictest0-21swapper/319:45:133
843799129,2cyclictest20340-21kworker/u8:120:17:052
843799129,2cyclictest20340-21kworker/u8:120:12:042
843699129,2cyclictest0-21swapper/123:31:191
843699129,2cyclictest0-21swapper/122:35:071
843699129,2cyclictest0-21swapper/121:51:051
843699127,3cyclictest2056-21apt-get21:55:111
843699122,6cyclictest0-21swapper/119:40:011
843699122,6cyclictest0-21swapper/119:25:001
843699122,5cyclictest0-21swapper/119:20:011
843699121,9cyclictest22141-21diskstats00:00:141
843699121,9cyclictest11877-21munin-node1
843699121,9cyclictest0-21swapper/119:55:131
843699121,9cyclictest0-21swapper/100:35:131
843699121,3cyclictest0-21swapper/121:05:261
843699121,3cyclictest0-21swapper/120:15:141
843699120,2cyclictest0-21swapper/121:35:091
843699120,2cyclictest0-21swapper/120:45:191
843699120,1cyclictest0-21swapper/123:10:181
843699120,11cyclictest24599-21diskmemload23:18:561
843699120,11cyclictest0-21swapper/123:25:251
843699120,11cyclictest0-21swapper/123:05:061
843699120,11cyclictest0-21swapper/123:00:461
843699120,11cyclictest0-21swapper/122:25:051
843699120,11cyclictest0-21swapper/121:30:181
843699120,11cyclictest0-21swapper/120:25:271
843599129,2cyclictest0-21swapper/020:05:160
843599120,2cyclictest0-21swapper/000:26:470
843899118,2cyclictest0-21swapper/320:55:173
843899118,2cyclictest0-21swapper/319:30:153
843899113,5cyclictest0-21swapper/320:20:233
843899111,7cyclictest0-21swapper/319:28:013
843799118,2cyclictest6330-21kworker/u8:120:45:042
843799118,2cyclictest20340-21kworker/u8:119:39:042
843699118,2cyclictest0-21swapper/122:16:201
843699118,2cyclictest0-21swapper/121:11:181
843699111,8cyclictest9011-21df_abs19:10:171
843699111,8cyclictest21280-21perl19:40:161
843699111,8cyclictest21280-21perl19:40:151
843699111,8cyclictest17278-21perl20:50:141
843699111,8cyclictest0-21swapper/120:55:191
843699111,2cyclictest24779-21apt-get19:50:111
843699110,9cyclictest0-21swapper/121:00:141
843699110,9cyclictest0-21swapper/120:10:151
843699110,3cyclictest8995-21cpuspeed_turbos20:30:141
843699110,2cyclictest0-21swapper/119:30:211
843599118,2cyclictest0-21swapper/020:20:260
843599110,2cyclictest0-21swapper/019:11:050
843899107,2cyclictest0-21swapper/321:00:183
843899106,2cyclictest381ktimersoftd/319:43:493
843899106,2cyclictest381ktimersoftd/319:43:483
843899104,4cyclictest12990-21tr19:20:143
843899102,6cyclictest0-21swapper/320:10:243
843799107,2cyclictest8260-21kworker/u8:119:22:052
843699100,8cyclictest11024-21df_abs19:15:161
843699100,8cyclictest0-21swapper/120:40:121
843699100,3cyclictest0-21swapper/120:35:121
843599107,2cyclictest0-21swapper/020:50:180
843599107,2cyclictest0-21swapper/019:20:130
84389994,3cyclictest8692-21apt20:30:113
84389991,3cyclictest0-21swapper/320:40:273
84379994,3cyclictest4490-21munin-node2
84379994,3cyclictest184642sleep220:54:022
84359996,2cyclictest0-21swapper/019:35:480
84359983,3cyclictest14829-21hostname20:45:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional