黑盒模型?顶级对冲基金Jane Street带你可视化神经网络

神经网络是现代人工智能的核心技术之一,但它们常常被认为是黑盒函数逼近器,由于其内部结构复杂,难以解释。幸运的是,理论工具的引入帮助我们更好地理解神经网络的行为,尤其是分段线性这一特性。本文将以更详细的方式介绍和可视化神经网络中的分段线性现象。

Jane Street 简介

Jane Street是一家全球知名的量化交易公司,专注于使用最先进的技术和算法进行金融市场交易。公司以使用函数式编程语言OCaml闻名,并且在技术社区中以创新的技术实践和开源项目作出了卓越贡献。Jane Street的技术团队不仅仅是支持交易的工具开发者,还在诸多前沿技术领域开展了深入研究。

什么是分段线性?

神经网络的一个核心特点是其分段线性性质。分段线性是指一个函数可以分解为多个线性部分,尽管这些部分的组合可能并不是线性的。这个特性帮助神经网络能够学习和逼近非线性问题中的复杂函数。

ReLU激活函数

一个常见的激活函数是ReLU(Rectified Linear Unit),它可以被看作由两个线性部分组成:当输入为正时输出等于输入;当输入为负时输出为零。因此,ReLU的激活函数可以被描述为以下形式:

这就是典型的分段线性函数,它在原点处连接两部分。

基础神经网络架构

我们讨论的神经网络架构是非常基础但功能强大的。其核心思想是将线性层与ReLU激活函数交替使用。这种结构在许多深度学习任务中被广泛应用。

首先,我们来看一个单层神经网络的例子。它有两个输入和一个输出神经元,输出神经元使用ReLU激活函数。输入分别位于x轴和y轴,而输出位于z轴。

ReLU的激活与关闭

在这个网络中,ReLU函数会在输入空间中划分出激活和非激活区域。在图中,左半部分ReLU关闭,输出为零;右半部分ReLU开启,输出等于输入。

神经网络只能学习连续分段线性函数

一个重要的限制是,神经网络只能学习连续的分段线性函数。这意味着网络无法学习不连续的函数。例如,以下是一个无法被神经网络学习的函数,因为它的两部分在边界处并不相连。

增加输出神经元

接下来,我们将模型复杂度提升一步。通过增加输出神经元的数量,可以看到网络划分的区域更多了。假设我们将输出神经元增加到8个,那么网络将形成更多的分段区域。每一个区域对应于某些ReLU被激活而其他未激活的子集,这就是所谓的激活模式

激活模式的组合

理论上,8个神经元应该有2^8 = 256种激活模式。然而,由于我们限制在二维空间中,实际上只有37种模式是可行的,其中32种可以在下图中可见。这些结构形成了一个复杂的几何结构,称为多面体复合体

以下是同一个几何结构的鸟瞰视角,它以逆时针旋转90度呈现:

添加第二层神经元

为了增加模型的复杂性,我们可以再添加一层神经元。这一层同样包含8个神经元,并且使用ReLU激活函数。为了在图中与第一层的线条区分,我们将第二层的线条绘制得更细

二层网络中的线性组合

因为线性函数的组合仍然是线性的,所以在第一层划分出的每个区域内,第二层的线条依然是直线。然而,当这些线条碰到分段边界时,线性函数发生变化,产生了弯折。若某个激活模式不可行,线条将会终止。

输出值的可视化

随着网络层次的增加,圆形结构开始出现,并在接下来的层次中进一步细化。输出值较高的区域用较亮的颜色表示,输出值较低的区域用较暗的颜色表示,这使得我们可以更加直观地理解神经网络的输出。

最终输出结果

以下是经过训练后的神经网络的最终输出结果。图中展示了神经网络输出的3D视角:

神经网络权重变化的演变

我们不仅可以研究单个经过训练的神经网络,还可以通过可视化整个多面体复合体来探索神经网络在训练过程中权重变化的演变。

首先,我们从一个随机初始化权重的未训练网络开始。随着训练的进行,网络逐步生成一些可识别的形状。未训练的权重会将输入平面划分为少量多边形,而随着训练的进行,更多的多边形会形成,逐渐表现出复杂的模式。

额外注释

  1. 1. 激活函数选择:尽管我们在解释中使用的是ReLU,但实际可视化中使用的是LeakyReLU(0.02),因为小型ReLU网络在训练时容易陷入局部极小值。
  2. 2. 输出维度:网络的输出现在是8维的,但为了方便可视化,我们选择了任意的线性投影,使得我们可以在三维空间中呈现结果。
  3. 3. 几何形状的准确性:技术上,这些区域中有些是无界的,因此并不是严格意义上的多边形。更准确的术语是**“半空间交集”**,即这些区域的边界延伸至无穷远。

previous_layer_regions = [euclidean_space]

for each layer:
    regions = []
    for parent_region in previous_layer_regions:
        for active_neurons in power_set_of_neurons:
            region = solve_constraints_for_activation_pattern()
            if region is feasible:
                regions.append(region)
    previous_layer_regions = regions

所有评论(208)

  1. admin说道:

    This message is used to verify that this feed (feedId:73016807219321856) belongs to me (userId:72982329363080192). Join me in enjoying the next generation information browser https://follow.is.

  2. Yesterday, while I was at work, my sister stole my iphone andd
    tested to see if it can survive a 25 foot drop, just so she can be a youtybe sensation. My apple ipad is noow broken and she
    has 83 views. I know this is completely off toipic but I had to share it
    with someone! https://hot-fruits-Glassi.blogspot.com/2025/08/hot-fruitsslot.html

  3. An outstanding share! I’ve jhst forwarded this onto a colleague who haas been conducting a little research on this.
    And he in fact ordered me lunch simply because I discovcered it for him…
    lol. So allow me to reword this…. Thanks forr the meal!!
    But yeah, thsnks for spending time to talk about tthis matter here on your website. https://skillnaukri.com/employer/tonybet/

  4. IndianIgniz说道:

    india pharmacy: IndiavaMeds – indian pharmacy

  5. ZacharyWhosy说道:

    https://aeromedsrx.com/# AeroMedsRx

  6. TristanSwamb说道:

    AeroMedsRx [url=https://aeromedsrx.xyz/#]viagra without prescription[/url] AeroMedsRx

  7. DavidDeaky说道:

    order Kamagra discreetly: kamagra oral jelly – Blue Wave Meds

  8. ZacharyWhosy说道:

    https://everameds.com/# buy cialis pill

  9. KennethNeuro说道:

    EveraMeds: п»їcialis generic – Generic Tadalafil 20mg price

  10. ZacharyWhosy说道:

    https://bluewavemeds.com/# trusted Kamagra supplier in the US

  11. DavidDeaky说道:

    Buy generic 100mg Viagra online: AeroMedsRx – AeroMedsRx

  12. ZacharyWhosy说道:

    http://bluewavemeds.com/# Blue Wave Meds

  13. TristanSwamb说道:

    Cialis 20mg price in USA [url=https://everameds.com/#]Buy Tadalafil 5mg[/url] EveraMeds

  14. ZacharyWhosy说道:

    https://bluewavemeds.xyz/# kamagra oral jelly

  15. TristanSwamb说道:

    Generic Cialis without a doctor prescription [url=https://everameds.xyz/#]EveraMeds[/url] EveraMeds

  16. DavidDeaky说道:

    kamagra: trusted Kamagra supplier in the US – trusted Kamagra supplier in the US

  17. ZacharyWhosy说道:

    https://aeromedsrx.xyz/# buy Viagra online

  18. TristanSwamb说道:

    order Kamagra discreetly [url=https://bluewavemeds.com/#]online pharmacy for Kamagra[/url] Blue Wave Meds

  19. DavidDeaky说道:

    AeroMedsRx: viagra without prescription – generic sildenafil

  20. DavidDeaky说道:

    EveraMeds: Tadalafil price – EveraMeds

  21. TristanSwamb说道:

    EveraMeds [url=https://everameds.com/#]EveraMeds[/url] Tadalafil Tablet

  22. KennethNeuro说道:

    cheapest cialis: Cialis over the counter – EveraMeds

  23. DavidDeaky说道:

    buy Viagra over the counter: AeroMedsRx – AeroMedsRx

  24. TristanSwamb说道:

    online pharmacy for Kamagra [url=https://bluewavemeds.xyz/#]kamagra[/url] kamagra

  25. ZacharyWhosy说道:

    https://bluewavemeds.com/# order Kamagra discreetly

  26. DavidDeaky说道:

    buy viagra here: cheapest viagra – sildenafil 50 mg price

  27. TristanSwamb说道:

    online pharmacy for Kamagra [url=http://bluewavemeds.com/#]trusted Kamagra supplier in the US[/url] trusted Kamagra supplier in the US

  28. ZacharyWhosy说道:

    https://aeromedsrx.xyz/# buy viagra here

  29. KennethNeuro说道:

    Tadalafil price: EveraMeds – Cialis 20mg price

  30. DavidDeaky说道:

    Blue Wave Meds: kamagra – trusted Kamagra supplier in the US

  31. TristanSwamb说道:

    Cheap Cialis [url=https://everameds.com/#]EveraMeds[/url] EveraMeds

  32. ZacharyWhosy说道:

    http://aeromedsrx.com/# AeroMedsRx

  33. DavidDeaky说道:

    EveraMeds: Buy Tadalafil 10mg – Cialis 20mg price

  34. TristanSwamb说道:

    EveraMeds [url=http://everameds.com/#]EveraMeds[/url] EveraMeds

  35. ZacharyWhosy说道:

    https://bluewavemeds.xyz/# online pharmacy for Kamagra

  36. DavidDeaky说道:

    AeroMedsRx: AeroMedsRx – Viagra generic over the counter

  37. TristanSwamb说道:

    online pharmacy for Kamagra [url=https://bluewavemeds.com/#]kamagra oral jelly[/url] online pharmacy for Kamagra

  38. DavidDeaky说道:

    fast delivery Kamagra pills: fast delivery Kamagra pills – order Kamagra discreetly

  39. TristanSwamb说道:

    Sildenafil Citrate Tablets 100mg [url=https://aeromedsrx.xyz/#]buy Viagra online[/url] viagra without prescription

  40. DavidDeaky说道:

    EveraMeds: Cialis 20mg price – Tadalafil Tablet

  41. TristanSwamb说道:

    online pharmacy for Kamagra [url=https://bluewavemeds.xyz/#]kamagra oral jelly[/url] online pharmacy for Kamagra

  42. ZacharyWhosy说道:

    https://bluewavemeds.com/# fast delivery Kamagra pills

  43. TristanSwamb说道:

    EveraMeds [url=https://everameds.com/#]EveraMeds[/url] Buy Tadalafil 5mg

  44. KennethNeuro说道:

    buy Viagra over the counter: AeroMedsRx – cheap viagra

  45. ZacharyWhosy说道:

    http://everameds.com/# EveraMeds

  46. DavidDeaky说道:

    buy cialis pill: EveraMeds – Generic Cialis price

  47. ZacharyWhosy说道:

    http://bluewavemeds.com/# buy Kamagra online

  48. DavidDeaky说道:

    trusted Kamagra supplier in the US: kamagra – buy Kamagra online

  49. TristanSwamb说道:

    kamagra oral jelly [url=https://bluewavemeds.com/#]BlueWaveMeds[/url] buy Kamagra online

  50. KennethNeuro说道:

    fast delivery Kamagra pills: kamagra – BlueWaveMeds

  51. DavidDeaky说道:

    AeroMedsRx: AeroMedsRx – AeroMedsRx

  52. TristanSwamb说道:

    EveraMeds [url=http://everameds.com/#]EveraMeds[/url] EveraMeds

  53. ZacharyWhosy说道:

    http://aeromedsrx.com/# Viagra online price

  54. DavidDeaky说道:

    sildenafil over the counter: AeroMedsRx – Generic Viagra online

  55. TristanSwamb说道:

    Sildenafil 100mg price [url=https://aeromedsrx.xyz/#]AeroMedsRx[/url] AeroMedsRx

  56. DavidDeaky说道:

    Buy Tadalafil 20mg: Tadalafil price – Cialis 20mg price

  57. TristanSwamb说道:

    viagra without prescription [url=https://aeromedsrx.xyz/#]AeroMedsRx[/url] AeroMedsRx

  58. KennethNeuro说道:

    EveraMeds: EveraMeds – EveraMeds

  59. DavidDeaky说道:

    kamagra oral jelly: buy Kamagra online – trusted Kamagra supplier in the US

  60. TristanSwamb说道:

    BlueWaveMeds [url=https://bluewavemeds.com/#]online pharmacy for Kamagra[/url] BlueWaveMeds

  61. ZacharyWhosy说道:

    https://aeromedsrx.com/# best price for viagra 100mg

  62. DavidDeaky说道:

    kamagra: order Kamagra discreetly – Blue Wave Meds

  63. TristanSwamb说道:

    Blue Wave Meds [url=http://bluewavemeds.com/#]fast delivery Kamagra pills[/url] Blue Wave Meds

  64. ZacharyWhosy说道:

    http://everameds.com/# Generic Tadalafil 20mg price

  65. RobertPople说道:

    IsoIndiaPharm: IsoIndiaPharm – indian pharmacy online

  66. Richarddioli说道:

    safe reliable canadian pharmacy https://mhfapharm.xyz/# MHFA Pharm

  67. HunterBruro说道:

    order antibiotics from mexico: UvaPharm – online mexican pharmacies

  68. RobertPople说道:

    canadian drugstore online: MHFA Pharm – reputable canadian pharmacy

  69. Richarddioli说道:

    canadian neighbor pharmacy https://mhfapharm.com/# MhfaPharm

  70. Forestwef说道:

    india online pharmacy [url=http://isoindiapharm.com/#]best india pharmacy[/url] IsoIndiaPharm

  71. Richarddioli说道:

    pharmacies in canada that ship to the us http://uvapharm.com/# pharmacys in mexico

  72. RobertPople说道:

    mexico medicine: UvaPharm – mexico pet pharmacy

  73. Richarddioli说道:

    canadian pharmacy service https://mhfapharm.com/# MhfaPharm

  74. RobertPople说道:

    UvaPharm: mexicanrxpharm – Uva Pharm

  75. Richarddioli说道:

    canadianpharmacymeds http://isoindiapharm.com/# Iso Pharm

  76. RobertPople说道:

    IsoIndiaPharm: IsoIndiaPharm – buy medicines online in india

  77. HunterBruro说道:

    Uva Pharm: mexican pharmacies – phentermine in mexico pharmacy

  78. Forestwef说道:

    online pharmacy in mexico [url=http://uvapharm.com/#]UvaPharm[/url] medicine mexico

  79. RobertPople说道:

    MHFA Pharm: MHFA Pharm – MhfaPharm

  80. Richarddioli说道:

    canadian pharmacy prices https://isoindiapharm.com/# IsoIndiaPharm

  81. HunterBruro说道:

    Online medicine order: IsoIndiaPharm – IsoIndiaPharm

  82. Forestwef说道:

    MhfaPharm [url=http://mhfapharm.com/#]MHFA Pharm[/url] MhfaPharm

  83. Richarddioli说道:

    canadian pharmacy http://uvapharm.com/# UvaPharm

  84. RobertPople说道:

    Iso Pharm: IsoIndiaPharm – Iso Pharm

  85. Richarddioli说道:

    real canadian pharmacy https://uvapharm.com/# UvaPharm

  86. RobertPople说道:

    best india pharmacy: IsoIndiaPharm – Iso Pharm

  87. Richarddioli说道:

    canadian neighbor pharmacy http://isoindiapharm.com/# Iso Pharm

  88. RobertPople说道:

    Uva Pharm: Uva Pharm – Uva Pharm

  89. Forestwef说道:

    IsoIndiaPharm [url=https://isoindiapharm.xyz/#]IsoIndiaPharm[/url] indian pharmacies safe

  90. Richarddioli说道:

    legit canadian pharmacy https://mhfapharm.com/# MhfaPharm

  91. Davidalege说道:

    Ucla Metformin [url=https://uclametformin.com/#]UclaMetformin[/url] UclaMetformin

  92. PatrickGrous说道:

    mail order pharmacy india http://socalabortionpill.com/# buy cytotec online

  93. CharlesProgs说道:

    UclaMetformin: UclaMetformin – 143 metformin

  94. DouglasEvepe说道:

    Socal Abortion Pill: buy misoprostol over the counter – Socal Abortion Pill

  95. PatrickGrous说道:

    online shopping pharmacy india https://pmaivermectin.com/# PmaIvermectin

  96. CharlesProgs说道:

    UclaMetformin: Ucla Metformin – metformin 1 mg

  97. Davidalege说道:

    BswFinasteride [url=http://bswfinasteride.com/#]BSW Finasteride[/url] BSW Finasteride

  98. DouglasEvepe说道:

    SocalAbortionPill: Socal Abortion Pill – buy abortion pills

  99. PatrickGrous说道:

    world pharmacy india http://socalabortionpill.com/# buy abortion pills

  100. CharlesProgs说道:

    PmaIvermectin: PmaIvermectin – PmaIvermectin

  101. PatrickGrous说道:

    online shopping pharmacy india http://pmaivermectin.com/# ivermectin 8000 mcg

  102. DouglasEvepe说道:

    metformin prescription online: metformin 500mg tablets price in india – metformin 1000 mg

  103. CharlesProgs说道:

    PmaIvermectin: ivermectin for kids – PmaIvermectin

  104. Davidalege说道:

    cost propecia no prescription [url=https://bswfinasteride.xyz/#]BswFinasteride[/url] buy cheap propecia without rx

  105. PatrickGrous说道:

    best india pharmacy https://pmaivermectin.com/# durvet ivermectin paste

  106. DouglasEvepe说道:

    SocalAbortionPill: Misoprostol 200 mg buy online – buy cytotec over the counter

  107. CharlesProgs说道:

    metformin.com: UclaMetformin – metformin 500 mg

  108. PatrickGrous说道:

    mail order pharmacy india http://uclametformin.com/# UclaMetformin

  109. PatrickGrous说道:

    top 10 online pharmacy in india https://bswfinasteride.xyz/# BswFinasteride

  110. DouglasEvepe说道:

    BSW Finasteride: BSW Finasteride – BswFinasteride

  111. Davidalege说道:

    PmaIvermectin [url=http://pmaivermectin.com/#]PmaIvermectin[/url] ivermectin dose for scabies

  112. CharlesProgs说道:

    PMA Ivermectin: PmaIvermectin – how to dose ivermectin for humans

  113. PatrickGrous说道:

    online pharmacy india http://uclametformin.com/# Ucla Metformin

  114. CharlesProgs说道:

    buy abortion pills: buy cytotec – Socal Abortion Pill

  115. DouglasEvepe说道:

    metformin medicine: metformin hcl 500 mg – UclaMetformin

  116. JoshuaFop说道:

    canadian pharmacies without prescriptions http://neokamagra.com/# NeoKamagra

  117. Cialisdueta说道:

    super kamagra: Neo Kamagra – Kamagra 100mg price

  118. Ramonked说道:

    Dmu Cialis [url=http://dmucialis.com/#]DmuCialis[/url] Dmu Cialis

  119. JoshuaFop说道:

    buying drugs canada http://muscpharm.com/# Musc Pharm

  120. Dmuaceks说道:

    DmuCialis: Dmu Cialis – DmuCialis

  121. Cialisdueta说道:

    Musc Pharm: canadian pharmacies top best – canadian neighbor pharmacy legit

  122. Ramonked说道:

    NeoKamagra [url=https://neokamagra.com/#]NeoKamagra[/url] NeoKamagra

  123. JoshuaFop说道:

    canadian pharma companies https://muscpharm.xyz/# MuscPharm

  124. Ramonked说道:

    NeoKamagra [url=http://neokamagra.com/#]sildenafil oral jelly 100mg kamagra[/url] Neo Kamagra

  125. Cialisdueta说道:

    DmuCialis: Dmu Cialis – Buy Tadalafil 10mg

  126. Dmuaceks说道:

    Dmu Cialis: DmuCialis – DmuCialis

  127. JoshuaFop说道:

    canadian pharmaceutical companies that ship to usa http://muscpharm.com/# MuscPharm

  128. JoshuaFop说道:

    safe online pharmacies http://dmucialis.com/# DmuCialis

  129. Ramonked说道:

    NeoKamagra [url=http://neokamagra.com/#]Neo Kamagra[/url] buy kamagra online usa

  130. Dmuaceks说道:

    DmuCialis: Dmu Cialis – Dmu Cialis

  131. JoshuaFop说道:

    canadian meds https://dmucialis.com/# DmuCialis

  132. Ramonked说道:

    canadiandrugstore.com [url=https://muscpharm.com/#]MuscPharm[/url] Musc Pharm

  133. Cialisdueta说道:

    DmuCialis: Dmu Cialis – Dmu Cialis

  134. JoshuaFop说道:

    reputable canadian pharmacy online https://neokamagra.xyz/# NeoKamagra

  135. Ramonked说道:

    NeoKamagra [url=https://neokamagra.com/#]Neo Kamagra[/url] NeoKamagra

  136. JoshuaFop说道:

    canadian pharmacies mail order https://neokamagra.xyz/# п»їkamagra

  137. Ramonked说道:

    MuscPharm [url=https://muscpharm.com/#]MuscPharm[/url] Musc Pharm

  138. Cialisdueta说道:

    Musc Pharm: Musc Pharm – MuscPharm

  139. JoshuaFop说道:

    compare medication prices http://muscpharm.com/# Musc Pharm

  140. Ramonked说道:

    Musc Pharm [url=http://muscpharm.com/#]Musc Pharm[/url] Musc Pharm

  141. Cialisdueta说道:

    mexican pharmacy online: canada pharmacy not requiring prescription – real canadian pharmacy

  142. JoshuaFop说道:

    compare prescription drug prices https://dmucialis.xyz/# DmuCialis

  143. Ramonked说道:

    Kamagra 100mg price [url=https://neokamagra.xyz/#]NeoKamagra[/url] NeoKamagra

  144. Cialisdueta说道:

    Kamagra 100mg price: Kamagra tablets – NeoKamagra

  145. JoshuaFop说道:

    discount canadian drugs https://muscpharm.xyz/# Musc Pharm

  146. Ramonked说道:

    NeoKamagra [url=https://neokamagra.com/#]sildenafil oral jelly 100mg kamagra[/url] Neo Kamagra

  147. Cialisdueta说道:

    Neo Kamagra: Neo Kamagra – sildenafil oral jelly 100mg kamagra

  148. JoshuaFop说道:

    great canadian pharmacy http://neokamagra.com/# NeoKamagra

  149. Ramonked说道:

    Kamagra tablets [url=http://neokamagra.com/#]buy kamagra online usa[/url] super kamagra

  150. JoshuaFop说道:

    cheap canadian drugs https://muscpharm.xyz/# amazon pharmacy drug prices

  151. Dmuaceks说道:

    Dmu Cialis: Dmu Cialis – Dmu Cialis

  152. Cialisdueta说道:

    MuscPharm: MuscPharm – rx canada

  153. JoshuaFop说道:

    online drugstore reviews https://muscpharm.xyz/# MuscPharm

  154. Dmuaceks说道:

    online pharmacies canada reviews: MuscPharm – recommended online pharmacies

  155. JoshuaFop说道:

    prescription drug price check https://neokamagra.com/# NeoKamagra

  156. Dmuaceks说道:

    Neo Kamagra: Neo Kamagra – Neo Kamagra

  157. Cialisdueta说道:

    Dmu Cialis: Dmu Cialis – DmuCialis

  158. JoshuaFop说道:

    canadian medicine https://neokamagra.com/# NeoKamagra

  159. Dmuaceks说道:

    Cialis without a doctor prescription: Generic Cialis price – DmuCialis

  160. DanielSot说道:

    CorPharmacy: Cor Pharmacy – online pharmacy non prescription drugs

  161. WilliamTop说道:

    ViagraNewark [url=http://viagranewark.com/#]Sildenafil Citrate Tablets 100mg[/url] Order Viagra 50 mg online

  162. Stevefed说道:

    safe canadian internet pharmacies http://edpillsafib.com/# EdPillsAfib

  163. JamesEvisy说道:

    ViagraNewark: buy Viagra online – Buy Viagra online cheap

  164. DanielSot说道:

    CorPharmacy: Cor Pharmacy – CorPharmacy

  165. WilliamTop说道:

    Ed Pills Afib [url=https://edpillsafib.com/#]Ed Pills Afib[/url] Ed Pills Afib

  166. Stevefed说道:

    canadian pharmacies recommended https://corpharmacy.xyz/# CorPharmacy

  167. JamesEvisy说道:

    Cor Pharmacy: Cor Pharmacy – CorPharmacy

  168. WilliamTop说道:

    Ed Pills Afib [url=http://edpillsafib.com/#]Ed Pills Afib[/url] best ed medication online

  169. Stevefed说道:

    internet pharmacies https://corpharmacy.com/# Cor Pharmacy

  170. JamesEvisy说道:

    Viagra Newark: ViagraNewark – ViagraNewark

  171. WilliamTop说道:

    EdPillsAfib [url=https://edpillsafib.xyz/#]EdPillsAfib[/url] EdPillsAfib

  172. WilliamTop说道:

    ViagraNewark [url=http://viagranewark.com/#]Viagra tablet online[/url] ViagraNewark

  173. Stevefed说道:

    prescription drug price check https://edpillsafib.com/# erectile dysfunction online

  174. DanielSot说道:

    sildenafil online: Viagra Newark – Viagra Newark

  175. WilliamTop说道:

    buy Viagra online [url=http://viagranewark.com/#]Viagra Newark[/url] ViagraNewark

  176. DanielSot说道:

    canadian pharmacy phone number: Cor Pharmacy – CorPharmacy

  177. JamesEvisy说道:

    Viagra Newark: ViagraNewark – Cheapest Sildenafil online

  178. JamesEvisy说道:

    Viagra Newark: Buy generic 100mg Viagra online – generic sildenafil