You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-24 - 16:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Wed Apr 24, 2024 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8315210880,6sleep10-21swapper/107:05:271
8658210786,16sleep00-21swapper/007:05:550
8844210679,6sleep20-21swapper/207:08:162
8885210277,6sleep30-21swapper/307:08:493
285842810,1sleep0101ktimersoftd/012:15:110
24732280,1sleep2301ktimersoftd/211:10:322
173962260,0sleep00-21swapper/010:15:190
900799223,2cyclictest0-21swapper/011:31:050
321662220,0sleep00-21swapper/008:15:160
9013992118,2cyclictest9895-21kworker/u8:210:15:043
9013992118,2cyclictest32447-21kworker/u8:009:24:043
9013992118,2cyclictest32447-21kworker/u8:009:24:043
9013992118,2cyclictest14857-21kworker/u8:212:22:043
9012992118,2cyclictest5048-21kworker/u8:109:21:042
9012992118,2cyclictest5048-21kworker/u8:109:21:042
9007992118,2cyclictest5659-21kworker/u8:011:10:040
9007992118,2cyclictest21224-21kworker/u8:009:15:040
9013992017,2cyclictest26956-21kworker/u8:209:29:043
9013992017,2cyclictest11881-21kworker/u8:109:35:053
9012992017,2cyclictest9895-21kworker/u8:210:20:042
901299200,18cyclictest0-21swapper/210:45:132
9009992017,2cyclictest5659-21kworker/u8:010:52:051
9009992017,2cyclictest21294-21kworker/u8:109:46:041
9009992017,2cyclictest14468-21kworker/u8:011:44:051
9007992017,2cyclictest9895-21kworker/u8:210:22:040
9007992017,2cyclictest9895-21kworker/u8:210:08:040
9007992017,2cyclictest32447-21kworker/u8:010:03:040
9007992017,2cyclictest32447-21kworker/u8:009:42:040
9007992017,2cyclictest28668-21kworker/u8:211:49:030
9007992017,2cyclictest27539-21kworker/u8:010:30:040
9007992017,2cyclictest26956-21kworker/u8:209:28:050
9007992017,2cyclictest26956-21kworker/u8:209:20:050
9007992017,2cyclictest26956-21kworker/u8:209:20:040
9007992017,2cyclictest21294-21kworker/u8:109:51:050
9007992017,2cyclictest21224-21kworker/u8:009:12:040
9007992017,2cyclictest17750-21kworker/u8:012:39:040
9007992017,2cyclictest14857-21kworker/u8:212:10:040
9013991916,2cyclictest3475-21kworker/u8:111:52:053
9013991916,2cyclictest26054-21kworker/u8:112:13:043
901399191,2cyclictest0-21swapper/311:31:043
901299190,2cyclictest0-21swapper/212:00:122
9009991916,2cyclictest14857-21kworker/u8:212:15:041
9007991916,2cyclictest27539-21kworker/u8:010:26:040
9007991916,2cyclictest20244-21kworker/u8:007:14:040
900799190,2cyclictest0-21swapper/010:12:040
286122190,1sleep30-21swapper/311:40:113
9013991815,2cyclictest5659-21kworker/u8:011:05:043
9013991815,2cyclictest32447-21kworker/u8:010:11:043
9013991815,2cyclictest25849-21kworker/u8:111:04:053
901399180,2cyclictest23089-21ssh09:46:043
901399180,2cyclictest0-21swapper/310:23:043
9009991815,2cyclictest32447-21kworker/u8:010:04:041
9009991815,2cyclictest14857-21kworker/u8:212:08:051
900999180,2cyclictest21374-21ssh11:31:041
900999180,2cyclictest0-21swapper/110:23:041
9007991815,2cyclictest3378-21kworker/u8:211:20:040
9007991815,2cyclictest32447-21kworker/u8:009:57:040
9007991815,2cyclictest32161-21kworker/u8:012:30:050
9007991815,2cyclictest25849-21kworker/u8:111:07:050
9007991815,2cyclictest24814-21kworker/u8:208:09:050
9007991815,2cyclictest21337-21kworker/u8:007:54:040
9007991815,2cyclictest21294-21kworker/u8:109:49:040
9007991815,2cyclictest20244-21kworker/u8:007:30:040
9007991815,2cyclictest14857-21kworker/u8:212:24:040
9007991815,2cyclictest14857-21kworker/u8:212:05:040
9007991815,2cyclictest10088-21kworker/u8:012:03:040
9007991815,2cyclictest10088-21kworker/u8:011:57:050
900799181,2cyclictest0-21swapper/011:44:040
900799180,2cyclictest0-21swapper/011:18:040
9013991714,2cyclictest32447-21kworker/u8:009:43:043
9013991714,2cyclictest26956-21kworker/u8:209:30:043
9013991714,2cyclictest25849-21kworker/u8:111:11:043
9013991714,2cyclictest24814-21kworker/u8:208:22:043
9013991714,2cyclictest20244-21kworker/u8:007:33:043
901399170,2cyclictest0-21swapper/311:18:053
901399170,2cyclictest0-21swapper/310:52:053
9012991714,2cyclictest14468-21kworker/u8:011:31:042
901299170,16cyclictest0-21swapper/208:45:132
9009991714,2cyclictest6522-21ssh09:29:051
9009991714,2cyclictest32447-21kworker/u8:010:09:041
9009991714,2cyclictest27539-21kworker/u8:010:29:031
9009991714,2cyclictest26054-21kworker/u8:112:12:041
9009991714,2cyclictest11242-21kworker/u8:107:24:041
9007991714,2cyclictest5659-21kworker/u8:010:50:040
9007991714,2cyclictest4519-21kworker/u8:112:26:040
9007991714,2cyclictest32694-21kworker/u8:110:35:030
9007991714,2cyclictest32447-21kworker/u8:009:39:030
9007991714,2cyclictest24814-21kworker/u8:208:11:040
9007991714,2cyclictest21699-21kworker/u8:111:35:040
9007991714,2cyclictest11242-21kworker/u8:107:41:050
9013991613,2cyclictest5048-21kworker/u8:108:55:043
9013991613,2cyclictest26956-21kworker/u8:209:16:053
9013991613,2cyclictest2668-21kworker/u8:008:26:053
9013991613,2cyclictest20244-21kworker/u8:007:19:043
9013991613,2cyclictest15300-21kworker/u8:209:02:043
9013991613,2cyclictest1293-21kworker/u8:109:59:033
9013991613,2cyclictest11242-21kworker/u8:107:23:043
9013991613,2cyclictest11184-21kworker/u8:008:50:053
901399160,2cyclictest0-21swapper/312:33:043
901399160,2cyclictest0-21swapper/311:38:043
901399160,2cyclictest0-21swapper/310:04:053
901399160,14cyclictest0-21swapper/310:43:103
901299161,13cyclictest0-21swapper/207:25:112
901299160,14cyclictest330350irq/24-eth111:45:142
9009991613,2cyclictest5048-21kworker/u8:109:11:041
9009991613,2cyclictest32447-21kworker/u8:009:32:041
9009991613,2cyclictest26956-21kworker/u8:209:17:041
9009991613,2cyclictest16738-21kworker/u8:207:38:041
9009991613,2cyclictest11242-21kworker/u8:108:03:041
9007991613,2cyclictest5048-21kworker/u8:108:53:040
9007991613,2cyclictest3378-21kworker/u8:211:29:040
9007991613,2cyclictest24814-21kworker/u8:208:34:050
9007991613,2cyclictest13650-21kworker/u8:110:49:040
9007991613,2cyclictest11242-21kworker/u8:108:02:040
9007991613,2cyclictest11242-21kworker/u8:107:25:030
9007991613,2cyclictest11184-21kworker/u8:008:47:040
900799160,2cyclictest0-21swapper/011:01:040
900799160,14cyclictest0-21swapper/011:54:040
9013991512,2cyclictest5659-21kworker/u8:010:45:033
9013991512,2cyclictest27539-21kworker/u8:010:32:043
9013991512,2cyclictest24814-21kworker/u8:208:32:043
9013991512,2cyclictest21337-21kworker/u8:007:55:043
9013991512,2cyclictest15300-21kworker/u8:209:05:043
901399150,2cyclictest7781-21ssh12:26:503
901399150,2cyclictest11034-21ssh10:09:043
901399150,2cyclictest0-21swapper/312:15:053
901399150,2cyclictest0-21swapper/308:49:033
901399150,2cyclictest0-21swapper/307:50:113
901399150,13cyclictest0-21swapper/310:57:003
901399150,13cyclictest0-21swapper/310:37:053
9012991511,2cyclictest20151-21perl10:55:182
901299150,14cyclictest0-21swapper/212:10:042
901299150,13cyclictest0-21swapper/209:37:452
9009991512,2cyclictest9895-21kworker/u8:210:37:041
9009991512,2cyclictest24814-21kworker/u8:208:39:041
9009991512,2cyclictest24814-21kworker/u8:208:06:051
9009991512,2cyclictest21294-21kworker/u8:109:52:051
9009991512,2cyclictest19650-21kworker/u8:210:58:041
9009991512,2cyclictest14857-21kworker/u8:212:23:041
9009991512,2cyclictest14468-21kworker/u8:011:25:041
9009991512,2cyclictest13902-21kworker/u8:309:36:041
9009991510,3cyclictest1439-21runrttasks09:58:441
9007991512,2cyclictest5688-21ssh10:40:050
9007991512,2cyclictest24814-21kworker/u8:208:43:050
9007991512,2cyclictest24814-21kworker/u8:208:36:040
9007991512,2cyclictest24814-21kworker/u8:208:23:040
9007991512,2cyclictest20244-21kworker/u8:007:18:050
9007991512,2cyclictest16738-21kworker/u8:207:47:040
9007991510,3cyclictest23177-21ssh10:58:560
294172151,3sleep10-21swapper/111:05:201
9013991411,2cyclictest14468-21kworker/u8:011:47:043
901399140,2cyclictest0-21swapper/311:59:043
901399140,2cyclictest0-21swapper/310:29:033
901399140,2cyclictest0-21swapper/309:11:043
901399140,2cyclictest0-21swapper/307:45:043
901399140,12cyclictest0-21swapper/312:05:423
9012991411,2cyclictest32447-21kworker/u8:010:12:042
9012991411,2cyclictest0-21swapper/210:16:142
901299140,2cyclictest8526-21sh12:28:042
901299140,2cyclictest0-21swapper/209:17:352
901299140,13cyclictest0-21swapper/210:42:342
901299140,12cyclictest20964-21diskmemload09:43:252
901299140,12cyclictest15153-21aten2.4_r3power10:50:162
901299140,12cyclictest0-21swapper/212:37:142
901299140,12cyclictest0-21swapper/212:05:452
9009991411,2cyclictest5048-21kworker/u8:109:00:041
9009991411,2cyclictest5048-21kworker/u8:108:54:041
9009991411,2cyclictest3378-21kworker/u8:211:12:041
9009991411,2cyclictest32161-21kworker/u8:012:29:041
9009991411,2cyclictest31423-21kworker/u8:108:16:051
9009991411,2cyclictest24814-21kworker/u8:207:58:041
9009991411,2cyclictest20964-21diskmemload09:40:181
9009991411,2cyclictest11242-21kworker/u8:107:42:051
9009991411,2cyclictest10824-21iostat_ios11:55:161
9009991411,2cyclictest0-21swapper/111:19:351
900999140,3cyclictest25449-21cat11:00:261
900999140,2cyclictest0-21swapper/110:15:051
900999140,12cyclictest0-21swapper/111:20:031
900999140,12cyclictest0-21swapper/109:21:111
900999140,12cyclictest0-21swapper/109:21:111
9007991411,2cyclictest5048-21kworker/u8:108:56:050
900799140,2cyclictest0-21swapper/009:32:040
901399139,3cyclictest7117-21munin-node3
9013991310,2cyclictest24814-21kworker/u8:208:42:043
9013991310,2cyclictest0-21swapper/308:10:123
901399130,2cyclictest0-21swapper/312:01:043
901399130,2cyclictest0-21swapper/311:25:053
901399130,2cyclictest0-21swapper/307:10:133
901399130,12cyclictest20964-21diskmemload12:39:523
901399130,12cyclictest0-21swapper/308:05:173
901399130,11cyclictest0-21swapper/311:20:513
9012991310,2cyclictest3378-21kworker/u8:211:18:052
9012991310,2cyclictest0-21swapper/210:39:242
9012991310,2cyclictest0-21swapper/209:52:032
9012991310,2cyclictest0-21swapper/208:25:132
9012991310,2cyclictest0-21swapper/207:10:252
901299130,2cyclictest10106-21apt-get11:55:112
901299130,2cyclictest0-21swapper/208:10:142
901299130,12cyclictest0-21swapper/212:34:042
901299130,12cyclictest0-21swapper/212:18:452
901299130,12cyclictest0-21swapper/211:07:442
901299130,12cyclictest0-21swapper/210:08:242
901299130,12cyclictest0-21swapper/209:10:542
901299130,11cyclictest0-21swapper/209:55:062
901299130,11cyclictest0-21swapper/208:05:252
9009991310,2cyclictest5048-21kworker/u8:108:58:041
9009991310,2cyclictest24814-21kworker/u8:208:41:041
9009991310,2cyclictest20964-21diskmemload12:35:181
9009991310,2cyclictest15300-21kworker/u8:209:06:051
9009991310,2cyclictest0-21swapper/112:03:131
9009991310,2cyclictest0-21swapper/111:50:271
9009991310,2cyclictest0-21swapper/111:46:381
9009991310,2cyclictest0-21swapper/110:32:481
9009991310,2cyclictest0-21swapper/110:10:111
9009991310,2cyclictest0-21swapper/108:20:311
9009991310,2cyclictest0-21swapper/107:45:081
900999130,2cyclictest0-21swapper/108:30:171
900999130,2cyclictest0-21swapper/107:30:061
900999130,12cyclictest0-21swapper/111:37:001
900999130,12cyclictest0-21swapper/110:46:081
900999130,12cyclictest0-21swapper/110:42:291
900999130,11cyclictest0-21swapper/112:30:221
900999130,11cyclictest0-21swapper/107:10:121
901399120,2cyclictest0-21swapper/309:52:043
901399120,2cyclictest0-21swapper/307:40:043
901299129,2cyclictest0-21swapper/211:43:152
901299129,2cyclictest0-21swapper/210:26:382
901299129,2cyclictest0-21swapper/209:49:182
901299129,2cyclictest0-21swapper/208:30:242
901299129,2cyclictest0-21swapper/208:15:212
901299120,2cyclictest0-21swapper/211:51:262
901299120,2cyclictest0-21swapper/211:36:182
901299120,2cyclictest0-21swapper/211:20:212
901299120,11cyclictest0-21swapper/211:02:142
901299120,11cyclictest0-21swapper/210:02:052
901299120,11cyclictest0-21swapper/209:00:152
900999129,2cyclictest20244-21kworker/u8:007:17:051
900999129,2cyclictest11242-21kworker/u8:107:26:051
900999129,2cyclictest0-21swapper/108:45:141
900999120,11cyclictest0-21swapper/107:50:281
900799129,2cyclictest0-21swapper/007:55:160
901399110,2cyclictest0-21swapper/308:16:053
901399110,2cyclictest0-21swapper/308:01:053
901299118,2cyclictest27539-21kworker/u8:010:31:042
901299118,2cyclictest0-21swapper/209:27:022
901299111,2cyclictest14830-21munin-node2
901299110,9cyclictest16567-21munin-node2
901299110,9cyclictest0-21swapper/212:20:182
901299110,9cyclictest0-21swapper/207:45:062
901299110,2cyclictest0-21swapper/208:00:202
901299110,10cyclictest0-21swapper/208:55:292
900799118,2cyclictest0-21swapper/008:25:150
900799111,8cyclictest19214-21aten2.4_r3power09:05:140
900799111,8cyclictest17412-21cut07:35:150
901299107,2cyclictest0-21swapper/208:35:122
901299101,8cyclictest926-21apt-get08:20:122
901299101,2cyclictest14932-21gpgv08:55:012
901299100,8cyclictest9145-21munin-node2
901299100,8cyclictest23510-21cpu07:55:132
901299100,8cyclictest0-21swapper/207:20:082
901299100,2cyclictest0-21swapper/209:30:092
901299100,2cyclictest0-21swapper/207:50:132
900999107,2cyclictest0-21swapper/108:10:171
900799107,2cyclictest0-21swapper/007:23:530
90139993,4cyclictest17891-21grep07:35:253
90139991,6cyclictest15046-21munin-node3
90129996,2cyclictest20244-21kworker/u8:007:31:042
90129995,3cyclictest20292-21sensors09:05:312
90099996,2cyclictest0-21swapper/108:25:171
90079994,3cyclictest17360-21egrep09:00:140
90129974,2cyclictest16738-21kworker/u8:207:40:042
90129970,2cyclictest0-21swapper/207:15:122
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional