You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-12 - 01:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Fri Dec 12, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
5724211791,19sleep00-21swapper/019:05:230
61592115104,6sleep10-21swapper/119:05:321
6443210594,6sleep30-21swapper/319:09:113
582329981,12sleep20-21swapper/219:05:252
292312830,1sleep20-21swapper/200:35:312
182082590,1sleep00-21swapper/023:50:480
6539993717,18cyclictest0-21swapper/323:55:143
41742270,1sleep30-21swapper/323:04:253
300852250,0sleep30-21swapper/300:36:483
73492230,0sleep10-21swapper/100:14:021
6538992314,6cyclictest21222-21ssh00:27:592
239162220,1sleep10-21swapper/122:17:091
653999210,4cyclictest28728-21sh22:22:053
653899211,18cyclictest0-21swapper/219:40:132
653799210,19cyclictest0-21swapper/120:20:131
653699211,18cyclictest10022-21ssh21:30:120
653699210,19cyclictest9-21ksoftirqd/021:55:160
653999200,18cyclictest0-21swapper/320:20:133
653899200,4cyclictest0-21swapper/222:22:052
653899200,15cyclictest0-21swapper/220:31:042
6537992016,2cyclictest332250irq/24-eth122:40:121
653799200,18cyclictest0-21swapper/123:20:151
653699200,18cyclictest26135-21ssh00:00:130
6539991916,2cyclictest30467-21kworker/u8:122:29:043
653899190,2cyclictest0-21swapper/220:45:142
653899190,15cyclictest0-21swapper/221:41:042
6539991815,2cyclictest15999-21kworker/u8:000:11:043
6539991814,2cyclictest19955-21kworker/u8:100:27:043
653999181,2cyclictest0-21swapper/323:25:093
653899180,2cyclictest0-21swapper/219:27:042
653899180,13cyclictest0-21swapper/223:19:042
653899180,13cyclictest0-21swapper/221:08:042
653799180,13cyclictest0-21swapper/122:50:171
95842170,0sleep10-21swapper/122:35:251
6539991714,2cyclictest8651-21kworker/u8:223:42:043
6539991714,2cyclictest30467-21kworker/u8:122:30:043
6539991714,2cyclictest10126-21kworker/u8:222:57:043
653999170,2cyclictest22658-21apt-get19:50:053
653999170,2cyclictest0-21swapper/319:27:043
653999170,16cyclictest0-21swapper/321:53:093
653899170,2cyclictest0-21swapper/223:00:042
653899170,2cyclictest0-21swapper/222:33:042
653899170,2cyclictest0-21swapper/219:50:052
653899170,16cyclictest0-21swapper/222:48:042
653899170,16cyclictest0-21swapper/222:48:042
653899170,16cyclictest0-21swapper/221:53:042
6537991712,3cyclictest25716-21memory19:55:171
653699171,14cyclictest28772-21pzem_current00:35:240
6539991613,2cyclictest32090-21kworker/u8:221:23:043
653999161,13cyclictest6749-21munin-node3
653999161,13cyclictest5758-21fschecks_time21:25:163
653999161,13cyclictest0-21swapper/322:00:183
653999160,14cyclictest0-21swapper/322:10:243
6538991613,2cyclictest4644-21kworker/u8:121:27:042
6538991613,2cyclictest1504-21kworker/u8:200:16:042
6538991613,2cyclictest12610-21kworker/u8:021:20:012
653899160,2cyclictest0-21swapper/223:27:042
653899160,15cyclictest0-21swapper/220:53:042
653899160,15cyclictest0-21swapper/220:24:042
653699161,3cyclictest0-21swapper/022:49:480
653699161,3cyclictest0-21swapper/022:49:480
653999152,2cyclictest0-21swapper/320:01:313
653999151,2cyclictest4669-21apt-get20:25:153
6539991512,2cyclictest1681-21kworker/u8:123:39:043
653999151,12cyclictest0-21swapper/321:16:503
653999150,2cyclictest13929-21sh00:20:183
653999150,13cyclictest22753-21diskmemload22:09:343
653999150,13cyclictest22723-21ssh21:42:473
653999150,13cyclictest0-21swapper/322:48:043
653999150,13cyclictest0-21swapper/322:48:043
653999150,13cyclictest0-21swapper/320:10:053
6538991512,2cyclictest0-21swapper/221:33:582
6538991511,2cyclictest0-21swapper/222:50:182
653899150,2cyclictest0-21swapper/223:58:052
653899150,2cyclictest0-21swapper/223:53:042
653899150,2cyclictest0-21swapper/220:42:052
653899150,2cyclictest0-21swapper/219:10:042
653899150,2cyclictest0-21swapper/200:31:042
653899150,13cyclictest0-21swapper/223:34:282
653899150,13cyclictest0-21swapper/223:10:182
653899150,10cyclictest0-21swapper/222:13:042
6537991512,2cyclictest0-21swapper/119:20:271
653799151,12cyclictest26804-21iostat_ios22:20:181
6537991510,3cyclictest0-21swapper/121:36:131
653799150,13cyclictest22753-21diskmemload23:30:571
653799150,13cyclictest0-21swapper/100:19:011
653699152,8cyclictest14490-21copy23:15:010
6536991512,2cyclictest11-21rcuc/023:40:250
6536991512,2cyclictest11-21rcuc/000:17:540
6536991511,2cyclictest0-21swapper/021:12:540
6536991510,3cyclictest32114-21cat00:05:250
653699150,3cyclictest13801-21rm00:20:170
653699150,3cyclictest0-21swapper/023:25:590
653999149,3cyclictest0-21swapper/322:43:463
6539991410,2cyclictest0-21swapper/322:17:533
653999140,2cyclictest0-21swapper/321:45:043
653999140,2cyclictest0-21swapper/320:42:043
653999140,2cyclictest0-21swapper/320:30:043
653999140,2cyclictest0-21swapper/300:31:043
653999140,2cyclictest0-21swapper/300:17:133
653999140,2cyclictest0-21swapper/300:03:533
653999140,1cyclictest0-21swapper/323:53:043
653999140,13cyclictest0-21swapper/320:45:143
653999140,13cyclictest0-21swapper/300:05:333
653999140,12cyclictest22753-21diskmemload21:56:263
653999140,12cyclictest0-21swapper/323:47:503
653999140,12cyclictest0-21swapper/323:30:083
653999140,12cyclictest0-21swapper/321:37:583
653999140,12cyclictest0-21swapper/320:55:133
6538991411,2cyclictest20577-21kworker/u8:119:58:042
6538991411,2cyclictest10126-21kworker/u8:222:38:052
6538991411,2cyclictest0-21swapper/222:07:382
6538991411,2cyclictest0-21swapper/200:05:182
6538991411,2cyclictest0-21swapper/200:04:282
653899140,5cyclictest0-21swapper/200:20:052
653899140,3cyclictest0-21swapper/221:16:042
653899140,2cyclictest0-21swapper/221:45:042
653899140,2cyclictest0-21swapper/220:13:042
653899140,12cyclictest0-21swapper/222:25:292
653899140,11cyclictest0-21swapper/219:34:042
653799149,2cyclictest0-21swapper/122:26:501
6537991411,2cyclictest0-21swapper/123:05:271
6537991410,2cyclictest0-21swapper/121:00:241
653799140,3cyclictest27926-21grep00:35:161
653799140,3cyclictest0-21swapper/123:52:421
653799140,12cyclictest5010-21snmpd23:27:151
653799140,12cyclictest0-21swapper/123:37:171
653799140,12cyclictest0-21swapper/122:45:071
653799140,12cyclictest0-21swapper/122:45:071
653699149,3cyclictest24111-21ssh23:57:290
653699149,3cyclictest13019-21unixbench_multi23:45:260
653699149,3cyclictest0-21swapper/023:04:140
653699142,7cyclictest0-21swapper/022:30:000
653699142,7cyclictest0-21swapper/020:55:010
653699142,7cyclictest0-21swapper/020:40:010
6536991411,2cyclictest101ktimersoftd/022:55:140
6536991411,2cyclictest101ktimersoftd/022:10:140
6536991411,2cyclictest0-21swapper/000:34:040
653699141,11cyclictest11-21rcuc/021:35:070
653699141,11cyclictest11-21rcuc/021:20:190
653699140,13cyclictest9-21ksoftirqd/022:08:240
653699140,12cyclictest9-21ksoftirqd/021:45:160
653699140,12cyclictest24000-21gzip22:50:270
653699140,12cyclictest22753-21diskmemload21:50:260
653699140,12cyclictest101ktimersoftd/019:15:000
653699140,12cyclictest0-21swapper/022:15:230
653699140,12cyclictest0-21swapper/020:20:170
653699140,12cyclictest0-21swapper/020:05:130
6539991310,2cyclictest4644-21kworker/u8:121:31:043
6539991310,2cyclictest22753-21diskmemload23:05:343
6539991310,2cyclictest19598-21kworker/u8:023:21:043
6539991310,2cyclictest0-21swapper/323:10:423
6539991310,2cyclictest0-21swapper/321:11:093
6539991310,2cyclictest0-21swapper/321:00:153
6539991310,2cyclictest0-21swapper/319:30:173
653999130,2cyclictest0-21swapper/322:50:013
653999130,2cyclictest0-21swapper/322:38:553
653999130,2cyclictest0-21swapper/321:05:233
653999130,2cyclictest0-21swapper/319:45:253
653999130,12cyclictest0-21swapper/320:05:203
6538991310,2cyclictest5478-21kworker/u8:019:38:042
6538991310,2cyclictest32023-21kworker/u8:022:02:042
6538991310,2cyclictest22595-21kworker/u8:320:08:012
6538991310,2cyclictest12401-21kworker/u8:221:38:042
6538991310,2cyclictest0-21swapper/223:41:082
6538991310,2cyclictest0-21swapper/222:57:332
6538991310,2cyclictest0-21swapper/221:57:582
653899130,2cyclictest0-21swapper/223:45:042
653899130,2cyclictest0-21swapper/222:40:532
653899130,2cyclictest0-21swapper/221:11:042
653899130,2cyclictest0-21swapper/220:58:042
653899130,12cyclictest0-21swapper/223:22:302
653899130,12cyclictest0-21swapper/223:05:112
653899130,11cyclictest0-21swapper/223:35:522
653899130,11cyclictest0-21swapper/222:15:402
6537991310,2cyclictest22753-21diskmemload23:04:281
6537991310,2cyclictest0-21swapper/123:15:541
6537991310,2cyclictest0-21swapper/122:00:131
6537991310,2cyclictest0-21swapper/120:05:171
653799130,2cyclictest0-21swapper/123:57:071
653799130,2cyclictest0-21swapper/123:43:291
653799130,2cyclictest0-21swapper/121:53:301
653799130,2cyclictest0-21swapper/100:25:181
653799130,12cyclictest0-21swapper/121:47:271
653799130,12cyclictest0-21swapper/100:34:071
653799130,12cyclictest0-21swapper/100:00:151
653799130,11cyclictest22753-21diskmemload21:29:581
653799130,11cyclictest0-21swapper/121:56:301
653799130,11cyclictest0-21swapper/121:17:001
653799130,11cyclictest0-21swapper/100:21:521
653699132,7cyclictest0-21swapper/023:30:010
6536991310,2cyclictest0-21swapper/023:35:380
6536991310,2cyclictest0-21swapper/023:22:080
6536991310,2cyclictest0-21swapper/021:16:360
6536991310,2cyclictest0-21swapper/019:40:160
653699130,2cyclictest9-21ksoftirqd/021:40:240
653699130,2cyclictest8453-21kworker/0:221:00:280
653699130,2cyclictest0-21swapper/021:05:290
653699130,12cyclictest0-21swapper/023:16:500
653699130,12cyclictest0-21swapper/022:43:260
653699130,12cyclictest0-21swapper/022:25:190
653699130,12cyclictest0-21swapper/022:21:280
653699130,12cyclictest0-21swapper/022:01:470
653699130,12cyclictest0-21swapper/021:25:130
653699130,11cyclictest22753-21diskmemload00:13:070
653699130,11cyclictest0-21swapper/019:55:260
58632130,3sleep20-21swapper/200:11:472
190182130,2sleep10-21swapper/122:12:051
653999129,2cyclictest10227-21kworker/u8:219:17:043
653999122,7cyclictest0-21swapper/320:50:013
653999120,7cyclictest0-21swapper/320:20:003
653999120,7cyclictest0-21swapper/320:20:003
653999120,2cyclictest0-21swapper/319:40:133
653999120,11cyclictest0-21swapper/323:15:023
653999120,11cyclictest0-21swapper/320:35:153
653999120,11cyclictest0-21swapper/319:37:243
653899129,2cyclictest30511-21kworker/u8:020:19:042
653899129,2cyclictest30511-21kworker/u8:020:19:042
653799129,2cyclictest0-21swapper/123:10:181
653799129,2cyclictest0-21swapper/122:55:511
653799129,2cyclictest0-21swapper/122:30:091
653799129,2cyclictest0-21swapper/121:20:091
653799129,2cyclictest0-21swapper/119:30:191
653799129,2cyclictest0-21swapper/119:15:151
653799121,9cyclictest0-21swapper/120:55:151
653799121,9cyclictest0-21swapper/119:50:061
653799120,3cyclictest11643-21apt-get22:05:161
653799120,2cyclictest22753-21diskmemload00:06:481
653799120,2cyclictest0-21swapper/120:45:251
653799120,11cyclictest0-21swapper/123:45:231
653799120,11cyclictest0-21swapper/121:31:071
653799120,11cyclictest0-21swapper/121:10:181
653799120,11cyclictest0-21swapper/121:05:291
653799120,11cyclictest0-21swapper/120:00:161
653699129,2cyclictest0-21swapper/023:05:020
653699129,2cyclictest0-21swapper/022:35:560
653699129,2cyclictest0-21swapper/000:25:190
653699120,2cyclictest0-21swapper/019:15:170
653699120,11cyclictest0-21swapper/020:55:160
653699120,11cyclictest0-21swapper/020:10:150
653699120,11cyclictest0-21swapper/019:50:070
653699120,11cyclictest0-21swapper/019:20:170
207612120,2sleep10-21swapper/121:40:221
132912120,1sleep1221ktimersoftd/119:25:141
653899112,6cyclictest0-21swapper/220:25:592
653899112,6cyclictest0-21swapper/219:20:582
653899110,6cyclictest0-21swapper/220:01:582
653899110,2cyclictest0-21swapper/221:04:052
653799118,2cyclictest0-21swapper/120:50:161
653799117,2cyclictest19378-21perl19:40:151
653799111,3cyclictest0-21swapper/120:25:191
653799110,9cyclictest8829-21munin-node1
653799110,9cyclictest0-21swapper/120:30:141
653799110,9cyclictest0-21swapper/120:10:131
653799110,10cyclictest0-21swapper/120:15:241
653799110,10cyclictest0-21swapper/120:15:241
653699118,2cyclictest0-21swapper/020:45:270
653699113,6cyclictest0-21swapper/019:30:500
653999107,2cyclictest10227-21kworker/u8:219:21:043
653999100,8cyclictest26742-21munin-run20:00:003
653899107,2cyclictest5478-21kworker/u8:019:15:042
653899101,6cyclictest12-21rcu_preempt19:45:242
653899101,5cyclictest0-21swapper/220:40:002
653799106,2cyclictest0-21swapper/119:45:121
653799101,2cyclictest7144-21diskstats19:10:151
653799100,8cyclictest0-21swapper/119:35:111
653699107,2cyclictest9-21ksoftirqd/019:25:170
653699107,2cyclictest0-21swapper/020:40:120
653699105,3cyclictest4732-21head20:25:150
653699105,3cyclictest1946-21grep20:15:250
653699105,3cyclictest1946-21grep20:15:250
653699101,6cyclictest0-21swapper/019:35:240
65379990,2cyclictest10851-21munin-node1
65369994,3cyclictest7897-21mailstats20:30:260
65369994,3cyclictest27253-21tr20:00:120
65369994,3cyclictest21956-21grep19:45:230
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional